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SUMMARY 


introduction 


This  report  documents  and  summarizes  the  progress  which 
has  been  made  toward  the  development  of  a Crisis  Early 
Warning  and  Monitoring  System.  The  work  was  conducted  for 
the  Defense  Advanced  Research  Projects  Agency's  Cybernetics 
Technology  Office. 

Overview  of  problem.  The  Early  Warning  and  Monitoring 
Project  has  been  addressing  several  problems: 


• the  development,  evaluation,  and  improvement  of 
procedures  for  warning  and  monitoring  of  inter- 
national security  crises; 

• the  identification  and  observation  of  quantitative 
non-military  indicators  for  crisis  warning;  and 

• the  integration  of  a variety  of  indicators  and 
methods  into  an  interactive,  user-oriented,  com- 
puter-based crisis  warning  system. 


Research  has  resulted  in  significant  progress  on  many 
aspects  of  these  general  problems.  Furthermore,  progress 
has  revealed  the  importance  of  a new  set  of  corresponding 
problems  including: 


• supplementing  the  crisis  warning  system  with 
monitoring  and  retrieval  systems; 
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integrating  the  hardware,  software,  and  method- 
ologies of  extant  computer-based  I&W  systems;  and 

implementing  an  efficient  and  effective  transfer 
of  the  system  to  the  user  community. 


Overview  of  solution.  Many  important  aspects  of  the 
initial  problem  set  have  been  resolved.  For  example,  the 
number  and  nature  of  quantitative  indicators  for  crisis 
warning  and  monitoring  have  been  expanded  and  the  indicators 
observed  and  tested.  Additionally,  the  indicators  and 
forecasting  methods  now  reside  in  an  interactive,  computer- 
based  system. 

This  research  effort  involved  five  different  tasks: 


• develop  prototype  system  by  adding  indicators  and 
exploring  linkages  with  military  indicator  systems; 

• test  and  evaluate  prototype  system's  indicators, 
scans  and  forecasting  methods,  add  data  sets,  and 
carry  out  real-time,  off-line  parallel  testing; 

• develop,  document,  and  assist  in  transfer  of 
interactive  computer  software; 

• test  and  evaluate  relationships  between  empirical 
methods  and  decision  analytic  methods  of  crisis 
warning;  and 

• explore  integration  of  subjective  and  objective 
methods  for  crisis  warning  and  management. 

Progress  on  the  Conceptual  Design  of  a Fully  Integrated  Earl 


Warning  and  Monitoring  System 


Interactions  with  potential  users  and  research  findings 
have  resulted  in  substantial  modifications  to  the  original 
system  design.  The  core  components  of  the  system-- (1) 
quantitative  crisis  indicators;  (2)  quantitative  indicators 
of  U.S.  interests  abroad;  (3)  a forecasting  capability;  and 
(4)  a computer  base — are  still  very  much  in  place.  However, 
the  emphasis  placed  on  them  has  been  modified  by  the  needs 
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of  potential  users  and  by  the  addition  of  new  conceptual 
components  such  as: 
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• general  scans; 

• current,  regularly  updated  data; 

• information  retrieval  and  monitoring  capabilities; 

and 

• amalgamation  with  extant  military  indicators. 


Progress  on  the  Development  of  the  Early  Warning  and  Moni- 


toring System 


In  addition  to  progress  on  and  modifications  to  concep- 
tual design,  advances  have  been  made  on  the  development  of 
crisis  indicators,  a forecasting  capability,  and  a computer 
base. 


Indicators . The  original  quantitative  international 
political  indicators,  including  levels  of  activity,  tension, 
and  uncertainty,  continue  to  be  modified  and  tested.  Addi- 
tionally, new  indicators  are  being  developed,  including 
regional  and  systemic  indicators  as  well  as  indicators 
developed  in  order  to  increase  hit  rates  and  lower  false 
alarm  rates. 


Forecasting  capability.  New  forecasting  methods  are 
now  being  developed.  The  current  focus  is  on  expanding  the 
indicators  with  which  forecasts  can  be  made,  developing  new 
forecasting  methods,  and  modifying  techniques  developed  by 
others  in  preparation  for  integration  into  the  system. 

Computer  base.  The  prototype's  computer  base  is  now 
supplied  by  DARPA/CTO's  Development  and  Demonstration  Facility 
(DDF).  The  computer  base  consists  of  an  event  data  base, 
interactive  software,  a PDP  11/70  minicompter,  Tektronix 
4051  graphic  terminals,  and  Tektronix  4631  hard  copy  units. 
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Testing  of  the  Early  Warning  and  Monitoring  System 

Extensive  testing  has  been  performed  on  all  components 
of  the  Early  Warning  and  Monitoring  System.  Such  testing 
has  been  facilitated  by  the  nature  of  the  prototype's  core 
data  base--the  DARPA-supported  World  Event  Interaction 
Survey  (WEIS).  The  data  base  now  consists  of  over  100,000 
non-routine  international  events  for  all  counties  in  the 
world  from  1966  to  the  present. 

Political  indicators.  Indicators,  probabilities,  and 
thresholds  have  been  tested  over  a large  number  of  historical 
crises.  Daily  updating  of  the  data  is  allowing  the  most 
crucial  aspect  of  testing — real  time  monitoring  and  warning 
on  a daily  basis. 

Military  indicators.  Preliminary  testing  of  the  syner- 
gism of  extant  military  indicators  with  the  political  ones 
of  the  Early  Warning  and  Monitoring  System  has  begun.  The 
focus  of  the  tests  has  been  on  comparing  the  monitoring  and 
warning  performance  of  the  two  sets  of  indicators  in  histori- 
cal crises. 

Economic  indicators.  Acquisition  of  weekly  economic 
data  and  OECD  economic  data  have  laid  the  groundwork  for 
testing  and  development  in  this  area. 

Domestic  indicators.  Domestic  indicators  for  potential 
integration  into  the  Early  Warning  and  Monitoring  System  are 
being  developed  and  tested  by  other  DARPA/CTO  Crisis  Manage- 
ment Program  contractors. 

Probabilities . Testing  of  the  primary  forecasting 
method  of  the  warning  system,  associative  generation  of 
probabilities,  has  resulted  in  substantial  modification  of 
the  method  and  greatly  improved  performance. 
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Demonstrating  the  Early  Warning  and  Monitoring  System 


The  master  demonstration  version  of  the  Early  Warning 
and  Monitoring  System  remains  extremely  flexible,  efficient, 
and  user-oriented.  The  system  now  provides  users  with  three 
types  of  output--tabular , graphic,  and  textual.  Users  can 
also  rapidly  retrieve  and  display  crisis  probabilities  and 
indicators  for  all  countries  and  regions. 

Exploring  Empirical  Science/Decision  Analysis  Methodological 
Overlap 


Research  in  this  area  has  focused  on  comparing  the 
performance  of  indicators  developed  with  the  two  method- 
ologies in  historical  crises  and  linking  the  different 
models,  output,  and  technologies. 

Future  Research 


Plans  for  future  research  center  around  expanding  the 
information  retrieval,  warning,  and  monitoring  components 
of  the  Early  Warning  and  Monitoring  System.  Immediate  plans 
call  for  enhancing  the  scanning  capacity  of  the  system, 
increasing  the  scope  of  the  crisis  indicators,  and  integrating 
complementary  forecasts.  New  components  such  as  an  automatic 
warning  and  monitoring  capability  are  also  under  consideration. 
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THE  EARLY  WARNING  AND  MONITORING  SYSTEM: 
A PROGRESS  REPORT 


1.0  INTRODUCTION 

A substantial  period  of  time  has  elapsed  since  the 
appearance  of  the  last  comprehensive  statement  of  the  pur- 
poses, design,  methods,  and  findings  of  the  Early  Warning 
and  Monitoring  System  (EWAMS)  project  (Andriole  1976a) . This 
report  documents  the  progress  that  has  been  made  on  the 
development,  testing,  evaluation,  demonstration,  and  transfer 
of  the  prototype  system  in  the  interim  and  outlines  what 
remains  to  be  done.^ 

1.1  Overview  of  the  Problem 

The  Early  Warning  and  Monitoring  System  project  initially 
addressed  several  problems: 

• the  development,  evaluation,  and  improvement  of 
procedures  for  warning  and  monitoring  of  inter- 
national security  crises; 

• the  identification  and  observation  of  quantitative 
non-military  indicators  for  crisis  warning; 

• the  integration  of  a variety  of  indicators  and 
methods  into  an  interactive,  user-oriented,  com- 
puter-based crisis  warning  system  (Andriole,  1976a, 
3-5)  . 

Research  over  the  past  months  has  resulted  in  signi- 
ficant progress  on  many  aspects  of  these  general  problems. 
Furthermore,  as  is  usually  the  case,  progress  has  revealed  a 
new  set  of  corresponding  problems  including: 

Dr.  Judith  Ayres  Daly  was  with  Decisions  and  Designs, 
Incorporated  during  the  time  period  in  which  this  research 
was  performed. 
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supplementing  the  warning  system  with  monitoring 
and  retrieval  systems; 
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• integrating  the  hardware,  software,  and  method- 
ologies of  extant  computer-based  Indications  and 
Warning  (I&W)  systems; 

• tailoring  EWAMS  to  user  needs;  and,  related  to 
that, 

• implementing  an  efficient  and  effective  transfer 
of  the  system  to  the  user  community. 

The  somewhat  altered  focus  of  these  new  problems  is  not 
meant  to  imply  that  all  the  initial  developmental  and  meth- 
odological questions  have  been  answered.  However,  the  shift 
in  focus  does  suggest  that  progress  both  permits  and  demands 
renewed  consideration  of  problems  of  purpose  and  transfer. 

1 . 2 Overview  of  a Proposed  Solution 

Many  important  aspects  of  the  initial  problem  set  have 
been  resolved.  For  example,  the  number  and  nature  of  quan- 
titative indicators  for  crisis  monitoring  and  warning  have 
been  expanded  and  the  indicators  observed  and  tested.  Addi- 
tionally, the  indicators  and  forecasting  methods  now  reside 
in  an  interactive,  computer-based  system. 

Potential  solutions  to  the  new  set  of  problems  have 
been  outlined.  Strategies  for  successful  conceptual  and 
methodological  transition  from  a monitoring  to  a warning 
system  have  been  designed.  Once  this  transition  is  made, 
users  will  be  provided  with  three  systems  in  one:  systems 
for  information  retrieval,  monitoring,  and  warning. 

While  integration  of  the  hardware,  software,  and 
methodologies  of  extant  I&W  systems  would  greatly  benefit 
the  Intelligence  Community,  it  is  currently  beyond  our 
purview.  However,  conceptual  integration  is  planned,  since 
it  will  enhance  the  development  and  capabilities  of  EWAMS. 
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The  Defense  Advanced  Research  Projects  Agency/Defense 
Intelligence  Agency  (DARPA/DIA)  Memorandum  of  Understanding 
(MOU)  of  July  1977  has  laid  the  groundwork  for  designing 
solutions  to  the  problems  of  responding  to  user  needs  and 
transfer.  In  addition,  interaction  with  DIA/NMIC  (National 
Military  Indications  Center)  personnel  will  greatly  facilitate 
performance  of  the  five  FY  78  tasks  specified  in  the  EWAMS 
project  proposal  of  June  1977.  These  tasks  are: 


• Develop  prototype  system  by  adding  indicators  and 
exploring  linkages  with  military  indicator  systems. 

• Test  and  evaluate  prototype  system's  indicators, 
scans  and  forecasting  methods,  add  data  sets,  and 
carry  out  real-time,  off-line  parallel  testing  at 
the  direction  of  the  Cybernetic  Technology  Office 
(CTO)  and  the  Contracting  Officer  Technical  Repre- 
sentative (COTR) . 

• Develop,  document,  and  assist  in  transfer  of 
interactive  computer  software. 

• Test  and  evaluate  relationships  between  empirical 
methods  and  decision-analytic  methods  of  crisis 
warning . 

• Explore  integration  of  subjective  and  objective 
methods  for  crisis  warning  and  management. 


2.0 


SUMMARY  OF  EFFORT 


2. 1 January  1976-September  1976 


In  broad  summary,  the  first  nine  months  of  effort  on 
what  is  now  the  Early  Warning  and  Monitoring  Prototype 
System  resulted  in: 


• the  design  for  a fully  integrated  crisis  early 
warning  system; 

• preliminary  development,  testing,  and  demonstra- 
tion of  a prototype  system  based  on  a limited  data 
set;  and 

• study  of  the  feasibility  of  blending  empirical  and 
decision  analytic  methods.! 


2.1.1  Initial  design.  The  components  of  the  design 
for  a fully  integrated  system  were: 


• quantitative  military,  political,  and  economic 
crisis  indicators; 

• quantitative  indicators  of  U.S.  military,  poli- 
tical, and  economic  interests  abroad; 

• a unified  multi-method  forecasting  capability;  and 

• a computer  base. 


Crisis  indicators.  The  range  of  crisis  indi- 
cators in  the  initial  design  for  the  integrated  system 

For  details  on  these  accomplishments  see  Appendix  B 
(Managerial  Memorandum  #1,  Research  Memorandums  #l-#4,  and 
Technical  Report  76-19) . 


included  internal  (domestic)  and  external  (international  and 
global)  static  and  dynamic  military,  political,  and  economic 
indicators. 


Indicators  of  U.S.  national  interests.  The 
design  also  included  quantitative  indicators  of  U.S.  national 
interests  designed  to  yield  insights  into  the  nature  and 
depth  of  U.S.  interests  abroad.  These  interests  were  classi 
fied  as  current,  emerging,  and  potential  and  ranked  on 
country-by-country  and  regional  bases. 

Unified  multi-method  forecasting  capability. 

The  unified  multi-method  forecasting  capability  required  the 
system  to  generate  different  kinds  of  forecasts  or  warnings 
via  different  methods  for  different  events  and  conditions. 

Such  options  were  designed  with  reference  to  the  objects, 
goals,  and  methods  of  forecasting. 

Computer  base.  The  system's  computer  base  was 
to  be  capable  of  efficiently  storing,  retrieving,  processing, 
and  displaying  large  quantities  of  information.  A computer 
base  comprised  of  data,  interactive  software,  and  flexible 
hardware  was  envisioned  for  the  integrated  system. 

Operation  of  the  integrated  crisis  warning  system. 
The  integrated  system  was  to  enable  a user  to  generate 
forecasts  or  warnings  on  regional,  country-by-country,  or 
national-interest  bases.  The  initial  design  also  permitted 
more  specific,  country-by-country  scanning,  as  well  as 
examination  of  specific  indicators  in  the  context  of  specific 
situations  over  varying  periods  of  time. 

2.1.2  Development,  testing,  and  demonstration.  In 
very  brief  summary,  progress  on  the  development,  testing, 
and  demonstration  of  the  system  through  September  1976  can 
be  stated  as  follows: 
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Development . In  the  last  technical  report, 
progress  regarding  the  development  of  the  prototype  crisis 
early  warning  system  was  described  in  terms  of  the  identi- 
fication and  specification  of  quantitative  indicators  for 
crisis  warning,  an  associative  forecasting  capability,  and  a 
computer  base. 

Crisis  indicators.  Prototype  indicators  were 
political  and  dynamic,  extracted  from  the  international 
level  of  analysis,  and  developed  with  reference  to  inter- 
national interaction.  The  specific  indicators  included 
levels  of  activity,  tension,  and  uncertainty.  Activity 
indicators  reflected  the  total  volume  of  events  sent  and/or 
exchanged,  as  well  as  the  volume  of  cooperative  and  conflic- 
tual  events.  Tension  levels  reflected  the  mix  of  coopera- 
tive and  conflictual  events,  while  the  uncertainty  indicator 
measured  the  range  of  event  types  sent  and/or  exchanged. 

Forecasting  capability.  The  prototype  was 
capable  of  forecasting  international  crises  on  a short- 
range,  retrospective  basis  via  an  associative  forecasting 
method,  which,  on  the  basis  of  past  crisis  behavior,  generated 
monthly  crisis  probabilities. 

Computer  base.  The  prototype's  computer  base 
consisted  of  an  events  data  base,  interactive  software,  a 
PDP  11/70  minicomputer,  Tektronix  4051  graphic  terminals, 
and  Tektronix  4631  hard  copy  units. 

In  order  to  test  the  ability  of  the  quantitative 
political  indicators  to  forecast  international  security 
crises,  a number  of  decisions  had  to  be  made  regarding  the 
selection  of  an  appropriate  data  base,  the  selection  of  test 
cases  (nations  and  crises) , and  the  nature  of  the  tests. 
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Data  base.  The  event  data  base  of  the  ARPA- 


supported  World  Event  Interaction  Survey  (WEIS)  was  selected 
for  test  purposes.  This  data  set  consisted  of  90,000  non- 
routine international  events  for  the  period  1966  to  1975. 

The  actors  in  the  WEIS  data  base  and  their  three-letter 
system  names  are  given  in  Figure  2-1. 

Test  cases.  Several  crisis  chronologies  yielded 
a preliminary  test  set  consisting  of  three  crises:  (1)  the 
January  1967  Sino-Soviet  border  clash;  (2)  the  August  1968 
Czechoslovakian  invasion;  and  (3)  the  November  1971  Inao- 
Pakistani  war.  In  addition  to  these  crises,  a fourth,  non- 
crisis case  was  examined  in  order  to  comparatively  determine 
the  possible  uses  of  the  indicators  in  non-crisis  situations. 
The  case  selected  was  U . S . /U . S . S . R.  dyadic  relations,  examined 
on  a quarterly  basis,  for  the  ten-year,  1966-1975  period. 

Nature  of  preliminary  test.  Since  the  data  base 
consisted  of  events  initiated  and  received  over  a ten-year 
period,  the  preliminary  tests  were  necessarily  retrospective. 
However,  the  tests  were  designed  to  simulate  crisis  fore- 
casting and  general  tracking  as  they  might  have  been  conducted 
had  such  capabilities  existed  during  the  1967,  1968,  1971 
monthly  pre-crisis  periods,  and  the  1966-1975  quarterly 
periods . 


Test  results.  Analysis  of  the  three  crisis  and 
one  non-crisis  periods  revealed  that  the  use  of  quantitative 
political  indicators  of  activity,  tension,  and  uncertainty 
would  have  significantly  improved  the  defense  community’s 
ability  to  forecast  the  crises  and  interpret  the  nature  and 

2 

direction  of  the  relations  between  the  U.S.  and  the  U.S.S.R. 

The  crisis  probabilities  generated  from  the  indicators  all 

rose  steadily  on  the  average  of  three  months  prior  to  the 

outbreak  of  the  crises.  Indeed,  the  tests  suggested  that 


For  detailed  analysis  of  these  results,  see  Andriole 
(1976a) : 37-54 . 
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Figure  2-1 

ALPHABETICAL  LISTING  OF  WEIS  COUNTRY  CODES 
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quantitative  political  indicators  could  be  used  indepen- 
dently or  in  conjunction  with  other  quantitative  (military 
and  economic)  indicators. 

Analysis  of  U.S.-U.S.S.R  relations  suggested  that  the 
indicators  could  be  used  for  other,  non-forecasting  purposes. 
Specifically,  a ten-year  quarterly  analysis  revealed  that 
activity,  tension,  and  uncertainty  increased  and  decreased 
at  various  times,  apparently  in  response  to  specific  events 
and  conditions.  Accordingly,  the  indicators  might  enable 
analysts  to  engage  in  what  may  be  described  as  aftermath 
analysis,  that  is,  assessment  of  the  impact  of  various 
events  and  conditions  upon  selected  patterns  of  interna- 
tional relations. 

Demonstrating  the  Crisis  Early  Warning  Proto- 
type System.  The  prototype  crisis  warning  system  was  geared 
to  the  development  of  a fully  integrated  crisis  warning 
system  and  to  how  such  a system  might  function  in  an  applied 
mode.  The  demonstration  prototype  system  was  thus  designed 
with  user  appeal  and  ease  of  operation  in  mind.  The  demon- 
stration system,  comprised  of  information  storage,  retrieval, 
processing,  and  tabular  and  graphic  display  capabilities, 
operated  in  a rapid  and  flexible  manner.  A user  could 
access  the  system  and  derive  crisis  probabilities  on  a 
number  of  levels.  In  addition,  a user  had  the  option  of 
retrieving  the  components  of  the  probabilities  via  displays 
of  one  or  more  of  the  political  indicators. 

2.1.3  Exploring  empirical  science/Bayesian  decision 
analysis  methodological  overlap.  The  empirical  science/ 
Bayesian  decision-analytic  methodological  overlap  was  iden- 
tified on  four  separate  planes.  It  was  suggested  that 
quantitative  empiricists  could  cooperate  with  decision 
analysts  regarding  the  generation  of  indicators,  the  sub- 
jective and  objective  evaluation  observation  of  indicators, 


the  generation  and  use  of  utilities,  and  the  use  of  hierar- 
chical inference  structuring  for  generalized  and  case-study 
crisis  modeling. 

2 . 2 September  1976-March  1978 

The  last  eighteen  months  have  resulted  in  considerable 
progress  in  all  these  areas.  This  progress,  briefly  sum- 
marized here,  is  reported  in  detail  in  Sections  3. 0-6.0. 

2.2.1  Progress  on  the  conceptual  design  of  a fully 
integrated  early  warning  and  monitoring  system.  The  com- 
bination of  interaction  with  potential  users  of  the  system 
and  research  findings  has  resulted  in  substantial  modifi- 
cations to  system  design.  The  core  components  of  the  system-- 
(1)  quantitative  military,  political,  and  economic  crisis 
indicators;  (2)  quantitative  indicators  of  U.S.  military, 
political,  and  economic  interests  abroad;  (3)  a unified 
multi-method  forecasting  capability;  and  (4)  a computer 
base--are  still  very  much  in  place.  However,  the  emphasis 
placed  on  them  has  been  modified  by  needs  of  potential  users 
and  by  the  addition  of  new  conceptual  components. 

The  warning/monitoring  feedback  loop.  System 
design  has  been  influenced  and  clarified  by  a clearer  con- 
ceptualization of  the  relationship  between  monitoring  and 
warning  processes.  Two  components  of  monitoring  and  warning 
are  receiving  a great  deal  of  attention:  indicator  thresholds 
and  the  requirement  for  current  data.  Strictly  speaking, 
thresholds  are  not  a new  system  component  but  their  impor- 
tance has  been  greatly  increased  by  two  concerns:  (1) 
requirements  of  the  user  community,  and  (2)  the  need  to 
successfully  make  the  transition  from  a monitoring  to  a 
warning  system.  For  EWAMS  to  be  useful  in  an  operational 
environment,  its  indicators  must  be  based  on  current  and 
regularly  updated  data.  This  requirement  has  influenced  the 
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amount  of  attention  we  have  devoted  to  developing  indicators 
included  in  the  original  design  of  a fully  integrated  crisis 
early  warning  system. 
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General  scans.  General  scans,  i.e.,  tracking 
groups  of  countries  defined  by  criteria  of  user  interest, 
are  designed  to  enhance  analyst  efficiency. 

Three  systems  in  one.  Clarification  of  the 
relationship  between  warning  and  monitoring  processes  has 
resulted  in  a qualitative  change  in  the  initial  design  of 
the  system.  The  change,  designated  by  the  term  "three 
systems  in  one,"  recognizes  that  a system  which  simply 
forecasts,  or  warns  of  crises,  is  insufficient.  EWAMS  is 
now  comprised  of  information  retrieval,  monitoring,  and 
warning  systems.  As  discussed  below,  there  are  advantages 
and  disadvantages  to  this  new  approach. 

Amalgamation  with  extant  indicator  systems.  It 
would  be  more  cost  effective  to  amalgamate  extant  I&W  systems 
rather  than  to  construct  a new  one  from  the  ground  up. 

2.2.2  Progress  on  the  development  of  the  Early  Warning 
and  Monitoring  System.  In  addition  to  progress  on  and 
modifications  to  conceptual  design,  advances  have  been  made 
on  the  development  of  indicators,  forecasting  capability, 
and  computer  base. 

Indicators . Not  only  have  the  original  quanti- 
tative international  political  indicators  been  modified  and 
tested,  but  new  ones  are  being  developed.  These  include  re- 
gional and  systemic  indicators  as  well  as  indicators  devel- 
oped in  order  to  increase  hit  rates  and  lower  false  alarm 
rates. 

Forecasting  capability.  Forecasting  methods 
other  than  those  currently  in  the  system  are  being  developed. 
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The  focus  is  on  expanding  the  numbers  of  indicators  with 
which  forecasts  can  be  made,  developing  new  forecasting 
methods,  and  modifying  techniques  developed  by  others  in 
preparation  for  integration  into  the  system. 

Computer  base.  The  prototype's  computer  base  is 
now  supplied  by  ARPA/CTO's  Development  and  Demonstration 
Facility  (DDF)  (Wittmeyer  1978) . 

2.2.3  Testing  of  the  Early  Warning  and  Monitoring 
System. 


Political  indicators.  Extensive  testing  has 
been  performed  on  all  components  of  EWAMS.  Such  testing  has 
been  facilitated  by  the  nature  of  the  prototype's  core  data 
base--the  ARPA-supported  World  Event  Interaction  Survey 
(WEIS).  WEIS  now  consists  of  over  100,000  non-routine 
international  events  for  all  countries  in  the  world  from 
1966  to  the  present.  The  nature  of  the  data  base  has  per- 
mitted testing  of  indicators,  probabilities,  and  thresholds 
over  a large  number  of  historical  crises.  Daily  updating  of 
the  data  has  just  begun  and  is  allowing  the  most  crucial 
aspect  of  testing — real-time  monitoring  and  warning  on  a 
daily  basis. 


Military  indicators.  Under  the  terms  of  the 
ARPA/DIA  Memorandum  of  Understanding,  preliminary  testing  of 
the  synergism  of  extant  military  indicators  with  the  poli- 
tical ones  of  EWAMS  has  begun.  The  focus  of  the  tests  has 
been  on  comparing  the  monitoring  and  warning  performance  of 
the  two  sets  of  indicators  in  historical  crises. 

Economic  indicators.  Acquisition  of  the  CIA 
Weekly  Economic  Indicator  data  and  the  Organization  of 
Economic  Cooperation  and  Development  (OECD)  economic  data 
has  laid  the  groundwork  for  testing  in  this  area. 
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Domestic  indicators.  The  University  of  Mary- 
land's Cross-National  Crisis  Indicators  Project  is  developing 
and  testing  domestic  indicators  for  potential  integration 
into  EWAMS. 

Probabilities . Testing  of  the  primary  fore- 
casting method  of  EWAMS,  associative  generation  of  proba- 
bilities, has  resulted  in  substantial  modification  of  the 
method  and  greatly  improved  performance. 

National  interests.  Testing  of  national  in- 
terest indicators  and  scans  has  been  facilitated  by  acqui- 
sition of  the  findings  and  data  of  the  National  Interests 
and  Early  Warning  Project.  This  project,  designed  speci- 
fically to  support  EWAMS,  has  been  completed.  However, 
since  the  data  are  not  being  kept  current,  integration  of 
national  interest  indicators  and  scans  into  the  master 
demonstration  system  remains  uncertain.  On-going  testing  of 
the  national  interest  work  should  help  ARPA/CTO  evaluate  the 
utility  of  a renewed  effort  in  this  area. 

2.2.4  Demonstrating  the  Early  Warning  and  Monitoring 
System.  The  master  demonstration  version  of  the  EWAMS  is 
now  in  its  third  generation.3  The  master  version  is  the 
focus  of  on-going  research  and  development  but  at  the  same 
time,  it  remains  extremely  flexible,  efficient,  and  user- 
oriented.  (A  partial  list  of  those  who  have  viewed  the  dem- 
onstration is  provided  in  Appendix  C.)  In  addition,  pro- 
vision of  a Tektronix  4051  (which  permits  display  of  both 
graphic  and  tabular  output  of  EWAMS)  to  DIA/NMIC  has  per- 
mitted many  informal  demonstrations  of  the  system's  capa- 
bilities and  allowed  DIA  analysts  to  experiment  at  their 
leisure. 

For  documentation  of  the  earlier  "Historical''  and 
"Real-Time"  versions,  see  DDI  (1978). 
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2.2.5  Exploring  empirical  science/decision  analysis 
methodological  overlap.  Exploration  of  the  empirical  science- 
decision  analysis  blend  has  been  primarily  centered  at  the 
NMIC  where  decision-analytic  models  for  I&W  are  being  used. 
Research  has  focused  on 


• comparing  the  performance  of  indicators  developed 
with  the  two  methodologies  in  historical  cases; 
and 

• linking  the  different  models,  output,  and  tech- 
nologies of  the  two  methodologies. 
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3.0  DESIGN  OF  A FULLY  INTEGRATED  EARLY 
WARNING  AND  MONITORING  SYSTEM 

The  combination  of  research  findings  and  interaction 
with  potential  users  has  resulted  in  valuable  modifications 
to  the  initial  design  of  a fully  integrated  system.  The  key 
components  of  the  system-- 

• quantitative  military,  political,  and  economic 

indicators  for  monitoring  and  warning; 

• quantitative  indicators  of  U.S.  national  interests 
abroad; 

• a unified  multi-method  forecasting  capability;  and 

• a computer  base — 

are  still  in  place. 

However,  the  relative  emphasis  placed  on  the  components 
has  been  modified  by  needs  of  potential  users  and  a more 
complete  understanding  of  the  warning  problem.  Consideration 
of  these  two  factors  has  resulted  in  conceptual  and  opera- 
tional additions  of  new  components,  as  well  as  in  the  expan- 
sion of  potential  functions  of  EWAMS.  Consequently,  a 
qualitative  change  in  the  design  of  EWAMS  has  evolved.  In 
the  original  system  design,  the  emphasis  was  almost  solely 
on  forecasting  or  warning  of  international  crises.  However, 
warnings  without  context  have  little  meaning.  Context  must 
be  provided  by  monitoring  and  information  retrieval  systems. 
New  components  of  the  EWAMS  design,  both  conceptual  and 
actual,  include: 

• the  monitoring/warning  feedback  loop; 

• general  scans; 

15 


amalgamation  with  extant  indicator  systems; 
"intelligent  I&W;"  and 


• conceptual  integration  of  I&W  and  operations 

processes. 

Expansion  of  the  system's  potential  functions  suggests 
that  EWAMS  can  serve  as  three  systems  in  one: 

• an  information  retrieval  system; 

• a monitoring  system;  and 

• a warning  system. 

3 . 1 The  Monitoring/Warning  Feedback  Loop 

3.1.1  Introduction.  In  recent  months,  the  ARPA/DIA 
Memorandum  of  Understanding  has  permitted  Early  Warning  and 
Monitoring  project  staff  to  interact  with  DIA/NMIC  personnel. 
This  contact  has  provided  us  with  new  perspectives  on  our 
attempt  to  develop  an  interactive,  computer-based  system  for 
early  warning  and  monitoring.  We  are  now  much  more  aware  of 
user  needs  and  responsibilities. 

In  addition  to  needs  of  the  I&W  community,  the 

Early  Warning  and  Monitoring  System  also  reflects,  to  a 

limited  extent,  the  new  emphasis  the  academic  community  has 

placed  on  the  study  of  monitoring  and  warning  processes  in 

recent  years. * The  monitoring  process  has  been  conceptualized 

as  involving  four  steps:  data  collection,  screening,  evalua- 

2 

tion,  and  threshold  setting.  To  date,  basic  research  has 

^The  best  examples  of  this  include  Snyder,  Hermann,  and 
Lasswell  (1976)  , the  many  thoughtful  and  suggestive  comments 
provoked  by  their  effort  in  subsequent  issues  of  International 
Studies  Quarterly,  and  the  theme  of  the  1977  International 
Studies  Association  Convention.  These  excellent  efforts  are 
long  overdue. 

2 

These  steps  are  described  by  Martino  ( 1972) : 237-42 . 
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focused  primarily  on  data  collection  and  screening,  tending 
to  neglect  evaluation  and  thresholding.  Given  the  impor- 
tance of  the  first  two  steps,  this  is  understandable.  As 
those  familiar  with  the  history  of  the  project  are  aware, 
the  Early  Warning  and  Monitoring  System  would  not  have  been 
possible  without  more  than  a decade  of  data  collection  and 
screening.  Without  the  efforts  of  dozens  of  individuals,  we 
would  not  have  the  foundation  of  the  system — the  WEIS  data 
and  the  methodology  which  accompanies  it.  Now,  however,  the 
conjunction  of  several  factors — 

• findings  from  years  of  basic  research, 

• advances  in  computer  technology,  and 

• access  to  an  operational  environment — 

not  only  permits  but  requires  greater  attention  to  the 
evaluation  and  thresholding  components  of  the  monitoring 
process  and  a conceptual  connection  between  it  and  the 
warning  process. 

3.1.2  From  monitoring  to  warning.  The  purpose  of 
monitoring  is  to  provide  signals  and  patterns  of  signals  for 
analysis.  The  objective  of  analysis,  which  in  part  involves 
attaching  thresholds  to  patterns,  is  to  warn  of  future 
events.  The  evaluation  component  of  monitoring  involves 
such  things  as  searching  for  patterns  in  signals;  separating 
signals  from  noise;  interpreting,  integrating  and  weighting 
signals;  and  relating  identified  patterns  to  context.  In 
short,  the  process  of  evaluation  consists  of  identifying 
possible  warning  patterns  in  signals  and  searching  for 
additional  signals  which  may  strengthen  or  disconfirm  the 
pattern.  If  a pattern  is  identified,  a threshold  is  attached 
to  it.  If  the  pattern  crosses  the  threshold,  a warning  is 
given. 3 

3Ibid. 
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Figure  3-1  illustrates  the  above  description  of 
the  monitoring  process.  As  a result  of  attempts  to  apply 
these  concepts,  we  have  learned  that  they  are  oversimplified. 
Since  monitoring  can  be  a process  unto  inself,  with  no 
intention  to  provide  warnings,  the  linkages  between  and 
among  the  concepts  must  be  clearly  specified.  As  illus- 
trated in  Figure  3-2,  monitoring  and  warning  must  be  linked 
in  a feedback  loop.  The  setting  of  thresholds,  and  the 
hits,  misses,  false  alarms  by  which  they  are  evaluated,  have 
a dual  role.  They  must  be  considered  at  both  the  monitoring 
and  warning  stages  of  the  whole  process.  The  warnings  given 
(or  not  given)  by  initial  thresholds  must  be  evaluated  in 
terms  of  their  hits,  misses,  and  false  alarms.  The  results 
of  this  evaluation  must  feed  back  to  the  monitoring  com- 
ponent to  improve  indicator  calculation,  weighting,  and 
integration;  data  collection  and  screening;  and  the  thresh- 
olds themselves. 

Not  only  must  monitoring  and  warning  be  con- 
sidered as  separate  but  linked  components  of  a single  pro- 
cess and  thresholds  be  given  a dual  role,  but  also  less 
obvious  considerations  must  be  included  in  the  process.  As 
illustrated  in  Figure  3-2,  the  variable  preferences  and 
responsibilities  of  the  decisionmaker  must  be  taken  into 
account.  Thresholds  must  not  be  set  solely  by  empirical 
considerations;  they  must  reflect  the  costs  of  misses  and 
false  alarms  as  well  as  the  relative  utility  of  hits  and 
correct  rejections.  User  preferences  and  responsibilities 
must  impact  on  the  tasks  of  threshold  setting  and  evaluation. 

3 . 2 Scans 

A scan  is  an  aggregation  of  countries  by  some  criteria, 
e.g.,  a scan  defined  by  geographic  location  would  aggregate 
countries  into  groups  such  as  a Middle  Eastern  region.  A 
general  scanning  capability  improves  the  monitoring  and 
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Figure  3 2 

FEEDBACK  LINKAGES  OF  THE  MONITORING  AND  WARNING  PROCESS 


warning  performance  of  the  system  in  many  ways.  A general 
scan  allows  an  analyst  to  look  at  several  countries  taken 
together  rather  than  singly  at  many  country  pairs.  If  the 
indicators  for  the  group  as  a whole  suggest  unusually  high 
activity,  tension,  or  uncertainty,  the  analyst  can  drop  to 
the  country-by-country  level  or  even  track  the  recent 
activity  of  a single  country  to  determine  the  source  of  the 
disturbance  on  the  regional  level.  General  scans  thus  make 
the  system  much  more  efficient  and  less  time-consuming  for 
the  analyst. 

More  specifically,  general  scans  have  four  purposes: 

(1)  to  increase  analyst  efficiency  and  save  him  time;  (2)  to 
lengthen  warning  time  before  crisis;  (3)  to  monitor  and  to 
provide  a characterization  of  the  relationship  between 
country  pairs  and  the  world  as  a whole;  and  (4)  to  facili- 
tate and  enhance  crisis  management. 

As  illustrated  in  Figure  3-3,  there  are  several  pos- 
sible types  of  general  scans:  (1)  Joint  Chiefs  of  Staff 
( JCS)  regions — which  are  currently  used  in  the  early  warning 
system;  (2)  other  geographical  regions;  (3)  systemic  scans; 

(4)  national  interest  scans;  (5)  attribute  typology  scans; 
and  (6)  foreign  policy  output  scans. 

The  master  version  of  EWAMS  is  now  front-ended  with  JCS 
regions.  This  particular  scan  allows  the  analyst  to  track  a 
JCS  region  as  a whole,  to  look  at  any  combination  of  countries 
within  the  region,  any  combination  of  countries  within  and 
without  the  region,  any  country  with  any  region,  and  to 
create  his  own  region.  While  potential  users  have  reacted 
very  favorably  to  JCS  regional  scans,  other  types  of  general 
scans  are  under  development.  Regional  scans  based  on  other 
than  JCS  considerations  would  contain  more  and  more  narrowly 
defined  regions.  For  example,  the  JCS  Middle  East  and  North 
Africa  region  might  be  broken  into  two  regions.  Final 
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incorporation  of  these  into  the  early  warning  system  will  be 
determined  by:  (1)  the  results  of  our  testing  and  evalua- 
tion; and  (2)  feedback  from  potential  users. 

Systemic  scans  would  compliment  a flexible  regional 

scanning  capability.  There  are  several  possible  types  of 

scans  of  the  whole  international  system.  One  which  will  be 

integrated  into  the  master  version  of  the  demo  in  the  very 

near  future  is  a variant  of  McClelland's  Event  Flow  Indica- 
4 

tors  (EFI)  which  has  been  successfully  tested  and  demon- 
strated to  yield  weekly  warning  and  tracking  of  threat 
conditions  in  the  international  political  system.  Another 
version  of  a systemic  scan  which  is  being  tested  and  evaluated 
will  yield  a weekly  alert  list  of  the  ten  most  likely  crises, 
i.e.,  the  ten  country  pairs  with  the  highest  crisis  probability. 

Scans  using  political  indicators  will  be  supplemented 
by  other  types  of  scans  such  as  national  interest  ones. 

There  are  several  possible  varieties  and  combinations  of 
national  interest  scans.  For  example,  scans  could  be  based 
on  the  political,  economic,  or  military  national  interests 
of  the  U.S.,  its  allies,  or  adversaries.  An  analyst  could 
track  just  those  countries  with  which  the  U.S.  has  a strong 
economic  tie  and  interest.  This  capability  requires  further 
testing  on  the  military  commitments  and  arms  transfers  of 
the  U.S.,  U.K.,  France,  West  Germany,  China,  and  Japan 
(Martin  1977b) . These  quantitative  indicators  of  military 
national  interests  are  being  evaluated  for  their  effectiveness 
as  a national  interest  scan. 

Scans  can  also  be  based  on  categorization  of  nations 
according  to  their  attributes  (see,  for  example,  Rossa  1977; 

East  1973;  Wilkenfeld  et  al.  1978).  For  example,  the 
analyst  might  want  to  track  just  large  developing  countries 
or  communist  countries.  Finally,  scans  based  on  foreign 
policy  output  typologies  should  be  explored  (see  Young  1975 

4McClelland  (1976). 
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and  Kegley  1973)  . An  analyst  might  track  only  diploma- 
tically active  or  hostile  countries. 

Cj  By  tracking  a group  of  countries,  whether  defined  by 

national  interests  or  regions  or  the  entire  system,  rather 
than  tracking  a large  number  of  country  pairs,  the  analyst 
makes  more  efficient  use  of  his  time.  If  the  quantitative 
t!  indicators  reveal  increased  conflictual  activity,  tension, 

or  uncertainty  at  the  general  scan  level,  the  analyst  can 
then  focus  on  the  country-by-country  level,  or  even  track  a 
single  country's  actions  to  determine  the  source  of  the 
p disturbance. 

Some  general  scans  should  also  lengthen  lead  time 
before  crises.  For  example,  changes  in  economic  national 
CJ  interests  are  sometimes  the  source  of  political/military 

crises.  An  analyst  tracking  countries  with  which  the  U.S. 

(or  its  allies  or  adversaries)  had  a strong  economic  tie, 
might  have  a great  deal  of  crisis  warning.  Other  types  of 
CJ  scans  should  also  lengthen  lead  time.  For  example,  greater 

warning  of  the  1973  Middle  East  War  was  provided  by  tracking 
U.S. -Soviet  relations  than  by  tracking  the  most  immediate 
participants  (Daly  1977) . The  several  types  of  scans  are, 

C of  course,  being  rigorously  tested  to  determine  their  utility 

for  early  warning. 

In  addition  to  increasing  analyst  efficiency  in  moni- 
C toring  and  providing  greater  warning  time,  both  of  which 

could  contribute  to  improved  crisis  management,  general 
scans  can  make  a direct  contribution  to  improved  performance 
by  operations  staffs.  This  could  be  accomplished  by  opera- 
t tions  contingency  planning  for  possible  crises  involving  the 

countries  covered  by  one  or  several  types  of  general  scans. 

Few  international  crises  have  only  two  participants  (recent 
crises  in  Africa  being  cases  in  point) . An  African  I&W 
< analyst,  using  a geographic  general  scan,  could  work  with 

: 


C 


24 


those  tasked  with  developing  contingency  plans  for  managing 
African  crises.  The  same  would  hold  for  warning  and  managing 
crises  stemming  from  economic  national  interests.  Coordination 
and  communication  between  the  I&W  analyst  and  those  tasked 
with  management  would  provide  the  manager  with  greater 
warning  time  and  supplement  his  expertise. 

3 . 3 Quantitative  Indicators  for  Early  Warning  and  Monitoring 

Along  with  the  EWAMS  computer  base,  the  quantitative 
indicators  are  the  foundation  of  the  system  design.  Without 
on-going  testing,  evaluation  and  improvement  of  these  indi- 
cators, the  newer  components  in  system  design  (both  concep- 
tual and  actual)  would  be  irrelevant  to  the  I&W  community. 

3.3.1  Range  and  use  of  indicators.  As  illustrated  in 
Figure  3-4,  the  range  of  indicators  in  the  system  design 
includes  domestic  and  international  political,  military,  and 
economic  ones.  The  indicators  are  both  dynamic  (events- 
based)  and  static  (attribute-based) . The  quantitative 
international  political  indicators  are  based  on  twelve  years 
of  historical  data  and  on  current,  regularly  up-dated  data. 

It  is  hoped  the  military,  economic,  and  some  of  the  domestic 
indicators  will  also  be  based  on  real-time  data  in  FY  78. 

The  quantitative  political  indicators  currently 
in  use  are  shown  in  Figure  3-5.  Other  indicators  are  cur- 
rently being  thoroughly  tested  and  evaluated  for  incorpora- 
tion into  the  system.  (Details  of  these  tests  can  be  found 
in  Section  4.2.)  For  example,  attribute-based  indicators 
can  serve  a dual  function:  In  addition  to  their  use  in 
general  scans  (discussed  in  Section  3.2),  attribute  data  can 
be  used  to  measure  and  monitor  relative  capabilities  of 
states  (Rummel  1963,  1972;  Daly  1976).  A measure  of  rela- 
tive capabilities  would  assist  the  I&W  analyst  in  determining 
which  potential  crises  have  the  most  risk  for  the  U.S.  or 
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its  allies.  To  continue  the  old  debate  over  the  importance 
of  intentions  versus  capabilities,  more  dynamic  indicators 
than  attribute-based  ones  can  be  used  to  measure  and  monitor 
intentions.  Such  indicators  can  be  generated  by  either 
empirical  or  subjective  means.  Inclusion  of  both  capability 
and  intention  indicators  in  the  prototype  would  supplement 
the  analyst's  own  expertise  on  the  relationship  between 
capabilities  and  intentions.  Developments  in  capabilities 
can  provide  an  empirical  basis  for  assessing  intentions. 
Furthermore,  measures  of  intentions  can  also  serve  as  a 
check  on  other  quantitative  crisis  indicators. 

Categorization  and  use  of  political,  military, 
and  economic  indicators  is  not  new  in  I&W.  Political  fac- 
tors are  viewed  as  (1)  the  context  for  military  activity  and 
(2)  as  the  determinants  of  the  decision  to  use  military 
force.  The  design  of  the  EWAMS  system  therefore  views 
political  indicators  as  useful  for  several  reasons.  First, 
with  the  possible  exception  of  surprise  attacks,  political 
indicators  will  tend  to  lead  military  ones  and  will  likely 
provide  greater  warning  time  before  crises.  Second,  poli- 
tical indicators  can  substantiate  or  disconfirm  interpre- 
tations based  on  military  or  economic  ones.  For  example, 
increased  military  activity  might  be  interpreted  as  an 
exercise.  However,  if  political  indicators  are  also  regis- 
tering increasing  enmity  between  two  countries,  a warning  of 
conflict  might  be  given.  This  suggests  a third  function  of 
political  indicators — they  may  help  distinguish  between 
exercises  and  actual  mobilizations  as  well  as  assist  inter- 
pretation of  the  reasons  for  a given  exercise,  i.e.,  whether 
it  is  "normal"  or  being  conducted  for  political  purposes. 

As  discussed  above,  setting  thresholds  for  indicators  is  a 
crucial  step  in  warning  based  on  quantitative  indicators. 
Therefore,  a final  use  of  political  indicators  for  the  EWAMS 
system  design  is  to  improve  the  performance  of  military 
indicator  thresholds  by  comparing  them  with  tested  and 


evaluated  political  indicator  ones.  In  summary,  the  use  of 
political  indicators  for  I&W  is  not  novel,  it  is  merely 
their  quantitative  nature  which  is  somewhat  new. 

Though  used,  economic  indicators  have  received 
less  attention  in  I&W.  Analysts  with  long  and  diverse  I&W 
experience  have  suggested  that  this  lack  of  attention  can  be 
attributed  to  the  few  post  World  War  II  conflicts  that  would 
illustrate  the  type  and  scope  of  economic  measures  that  a 
highly  industrialized  state  might  take  in  preparation  for 
major  hostilities.  Another  factor  contributing  to  the 
present  status  of  economic  indicators  is  the  difficulties 
involved  in  developing  or  obtaining  valuable  world-wide 
economic  time-series  data  for  small  temporal  aggregations. 
However,  economic  indicators  have  been  included  in  system 
design  on  the  assumption  that  they  are  a measure  of  national 
priorities,  of  resource  allocation  (or  reallocation)  for  war 
or  peace.  To  the  extent  this  assumption  is  correct  and 
indicators  can  be  developed  to  measure  changes  in  allocation 
of  economic  resources  toward  war,  economic  indicators  will 
provide  greater  warning  time  of  conflict  than  political  ones 
and  political  indicators  will  in  turn  lead  military  ones. 

Finally,  military,  economic,  political,  and 
domestic  indicators  can  be  used  for  information  retrieval, 
monitoring,  and  warning.  For  example,  indicators  of  the 
economic  or  military  relations  between  two  countries  can  be 
used  to  guide  retrieval  of  historical  information  as  well  as 
to  develop  profiles  for  monitoring.  The  monitoring  function 
in  turn  informs  warnings  generated  by  the  indicators.  For 
example,  suppose  an  analyst  warned  his  supervisor  that 
troops  were  massing  on  the  border  of  countries  X and  Y. 

The  seriousness  and  potential  implications  of  such  military 
action  would  be  difficult  to  evaluate  independent  of  current 
information  on  the  political  and  economic  relations  between 
the  countries  as  well  as  information  on  past  military  actions 
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of  a similar  nature.  The  indicators  are  the  core  of  each  of 
the  three  separable  but  related  EWAMS  functions.  As  such, 
they  serve  as  the  link  between  its  information  retrieval, 
monitoring,  and  warning  functions. 

3.3.2  Generation  of  indicators.  The  methodology  under- 
lying the  quantitative  international  political  indicators 
has  been  thoroughly  documented  elsewhere  (Andriole  1976a: 
25-32).  The  University  of  Maryland's  Cross-National  Crisis 
Indicators  Project  is  developing  and  testing  intranational 
indicators  for  warning  and  monitoring.  These  will  eventually 
be  integrated  into  EWAMS  and  provide  the  system  with  the 
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capacity  to  monitor  and  warn  of  domestic  conflicts. 

Generation  of  military  indicators  is  proceeding 
along  two  fronts.  As  any  reader  of  a daily  newspaper  is 
aware,  some  data  on  dynamic  military  events  is  publicly 
available.  Indeed,  much  of  it  appears  in  the  WEIS  political 
data  set.  However,  this  data  is  quite  different  from  clas- 
sified military  indicators  in  terms  of  specificity,  variety, 
and  immediacy.  Therefore,  the  primary  thrust  of  the  work  on 
military  indicators  has  not  been  to  generate  new  ones,  but 
to  compare  political  indicators  with  extant  military  indi- 
cators. How  this  type  of  military  indicator  will  be  incor- 
porated into  system  design  is  still  uncertain.  Depending  on 
research  results  and  bureaucratic  politics,  political  and 
military  indicator  systems  could  be  run  in  parallel  or, 
alternatively,  integrated  into  one  system.  (For  elaboration 
on  this  work,  see  Section  4.2.)  The  second  thrust  of  the 
work  on  military  data  has  involved  indicator  development 
from  public  source  data.  In  general,  this  attribute  data  is 
more  static  and,  thus,  more  relevant  to  the  scanning  capa- 
bility than  to  dynamic  daily  monitoring. 

The  current  focus  on  economic  indicator  genera- 
tion has  been  on  dynamic  indicators  such  as  currency  exchange 

5See  Wilkenfeld  & Hopple  (1977). 
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rates.  This  is  in  consonance  with  our  present  emphasis  on 
current,  "real-time"  monitoring  and  warning.  Data  sources 
for  such  economic  indicators  include  the  U.S.  Government's 
weekly  economic  indicators^  and  OECD  data.7 

3.3.3  Indicators  of  U.S.  national  interests.  Those 
familiar  with  the  history  of  EWAMS  have  by  now  noted  that 
indicators  of  U.S.  national  interests  have  become  less 
salient  in  system  design.  This  is  not  because  expectations 
of  their  substantive  importance  have  been  lowered.  As 
suggested  by  the  sections  on  scans  and  linkage  of  crisis 
warning  and  management  functions,  the  conceptual  role  of 
national  interest  indicators  has  been  expanded.  If  they 
seem  to  be  less  prominent  in  system  design,  it  is  because 
potential  users  of  EWAMS  require  current  data,  and  our 
research  efforts  must  be  devoted  to  indicators  for  which 
there  is  and  will  continue  to  be  such  data.  While  the 
excellent  work  done  on  the  military  commitment  interests  of 
the  U.S.,  U.K.,  U.S.S.R.,  France,  West  Germany,  Japan  and 
China  supports  the  dual  role  of  national  interests  in  system 
design,  that  effort  has  terminated  (Martin  1977a,  1977b,  1976). 
Until  updated  and  current  data  on  U.S.  national  interests  is 
available,  it  cannot  be  included  among  those  components  of 
system  design  to  which  most  intensive  research  effort  is 
devoted. 

3 . 4 Computer  Base 

The  ARPA/CTO  Development  and  Demonstration  Facility 
(DDF)  provides  the  computer  base  for  EWAMS.  Current  status 
of  the  DDF-based  EWAMS  hardware  and  software  can  be  sum- 
marized as: 

^A  publication  entitled  Economic  Indicators  Weekly 
Review,  prepared  by  the  U.S.  Government  and  distributed 
on  a subscription  basis  by  the  Document  Expediting  (DOCEX) 
Project,  Library  of  Congress. 

7This  data  has  been  provided  through  the  cooperation  of 
the  U.S.  Department  of  State  and  Mr.  Robert  Sarsfield. 
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m Hardware 

PDP  11/70  minicomputer 

— 128  K words  with  cache  memory 

— 88  million  characters  of  off-line  storage 

— 9 track  magnetic  tape  off-line  storage 

Tektronix  4051  graphic  terminals 

Tektronix  4631  hardcopy  units 

Tektronix  4097  floppy  disc 

• Software 

UNIX  operating  system 
CULC’s  FORTRAN  IV  Plus 
Tektronix  Plot  10 
— TCS  (Terminal  Control  System) 

— AGII  (Advanced  Graphing  II) 

Binary  and  Random  Access  Data  Files 


Short-term  enhancements  planned  for  EWAMS  hardware 
and  software  include: 


• Hardware 

Univac  1652 
Joystick 
Light  Pen 

• Software 

Overlays 

Calendar  routines 
Additional  Graphics 
- Maps 

Help  Routines 
Stat  Pak  Interfacing 

To  an  extent,  long-range  design  of  the  EWAMS  computer  base 
depends  on  the  DDF  design  which  is,  of  course,  under  separate 
purview.  However,  it  is  the  goal  of  both  EWAMS  and  DDF 
personnel  to  test  and  transfer  a fully  integrated,  flexible 
interactive  computer-based  early  warning  and  monitoring 
system. 


3 . 5 Three  Systems  in  One 

Though  retrospective  application  of  the  Early  Warning 
and  Monitoring  System  has  illustrated  many  problems,  it  also 
demonstrates  the  great  potential  of  the  system.  In  light  of 
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the  myriad  problems  and  issues  still  to  be  resolved,  perhaps 
the  greatest  danger  revealed  by  our  interaction  with  potential 
users  is  retreat  from  the  potential  to  something  that  is 
merely  an  information  retrieval  system.  Thus  a broad  com- 
prehensive problem  is: 

• Information  retrieval  vs.  warning  and  monitoring 
- How  can  devolution  from  a warning  and/or 

monitoring  system  to  an  information  retrieval 
system  be  avoided? 

An  information  retrieval  system  would  be  "safe":  many  of  the 
critical  problems  associated  with  it  have  already  been 
solved.  An  information  retrieval  system  alone  would  benefit 
I&W  analysts.  However,  the  requirements  of  real-world  I&W 
suggest  we  cannot  afford  to  "play  it  safe";  we  cannot  scale 
down  our  objectives  in  the  face  of  diverse  and  difficult 
problems. 

A more  positive  statement  of  the  devolution  problem 
would  be: 

How  can  a monitoring  system  successfully  make  the 

transition  to  a warning  system? 

The  answer,  of  course,  requires  solutions  to  many  problems 
and  issues.  And  the  solutions  must  reflect  extensive  and 
detailed  input  from  the  user  community.  Such  input  will  not 
only  help  us  make  the  transition  from  monitoring  to  warning; 
by  showing  the  potential  of  the  system  to  real-world  analysts, 
it  will  hopefully  convince  users  that  something  more  than  an 
information  retrieval  system  would  be  of  use  to  them. 

One  way  of  doing  this  is  to  offer  three  systems  in  one. 
Analysts  could  then  use  one  or  all  system  functions  of 
information  retrieval,  monitoring,  or  warning.  Use  would  be 
determined  in  part  by  analyst  responsibilities  and  preferences. 
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As  illustrated  in  Figure  3-6,  EWAMS  has  information 
retrieval,  monitoring,  and  warning  capabilities.  Informa- 
tion retrieval  is  represented  by  the  ability  to  obtain  the 
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+ 
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+ 
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Figure  3-6 

THREE  SYSTEMS  IN  ONE 


textual  information  from  which  the  quantitative  indicators 
are  generated,  as  well  as  tables  and  graphs  of  these  indi- 
cators. Monitoring  consists  of  EWAMS  capability  to  describe 
relationships  among  countries  and  regions  (both  with  the 
world)  on  a current,  daily  basis  in  terms  of  several  quanti- 
tative political  indicators  or  narrative  information.  The 
latter  provides  context  to  the  analyst,  enabling  him  to  more 
readily  interpret  the  signals  of  the  quantitative  indicators. 
Warning  capability  currently  consists  of  an  associative 
generation  of  conflict  probabilities.  Pattern  analysis 
provided  by  retrospective  monitoring  is  the  foundation  of 
these  warning  probabilities. 

Modifications  and  enhancements  to  each  of  these  systems 
have  been  designed.  Eventually,  economic,  military,  and 
domestic  information  of  both  the  events  and  attribute  types 
will  be  retrievable.  Monitoring  capability  will  likewise  be 
expanded  in  terms  of  substance  that  can  be  described  and 
patterns  that  can  be  analyzed.  The  plans  for  enhancement  of 
warning  capabilities  are  the  most  ambitious  enhancement. 
Military,  economic,  and  domestic  indicators  for  warning  are 
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being  developed  and  tested  in  preparation  for  integration 
into  EWAMS.  The  method  for  associative  generation  of  proba- 
bilities is  being  tested  and  refined  and  thresholds  for  the 
indicators  are  being  developed.  In  addition,  different 
forecasting  methods  are  being  developed  by  other  Crisis 
Management  Program  contractors.  (Werbos  1977;  Duncan  and 
Job  1977)  If  testing  and  evaluation  are  successful,  these 
forecasting  methods  will  be  integrated  into  EWAMS. 

These  modifications  and  enhancements  to  the  design  of 
the  information  retrieval,  monitoring,  and  warning  capa- 
bilities of  EWAMS  will  enhance  the  utility  of  the  system  to 
those  in  the  I&W  community.  The  design  and  development  of 
three  systems  in  one,  rather  than  incremental  phased  develop 
ment  and  introduction,  is  intended  to  demonstrate  the  poten- 
tial of  an  interactive  computer-based  warning  system. 

3 . 6 Conceptual  Design  of  an  Integrated  Early  Warning 

and  Monitoring  System 

In  the  preceding  discussion,  mention  has  been  made  of 
both  current  status  and  future  design  of  EWAMS.  Figures  3-7 
and  3-8  illustrate,  respectively,  the  primary  outputs  and 
functions  of  the  present  system  and  its  planned  development. 
A comparison  of  the  figures  suggests  four  topics  that  will 
need  to  be  addressed  as  the  design  is  implemented:  integra- 
tion/amalgamation of  indicators,  transitioning  from  moni- 
toring to  warning,  exploring  linkages  between  warning  and 
management  functions,  and  "intelligent"  I&W. 

3.6.1  Integration/amalgamation  of  indicators.  Prob- 
lems with  indicator  integration  occur  on  two  levels.  The 
first  concerns  integrating,  interpreting,  and  weighting  the 
varying  signals  of  different  indicators  of  one  generic  type, 
e.g.,  five  international  political  indicators.  Ongoing 


research  suggests  this  is  a difficult  but  solvable  problem. 
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As  illustrated  by  Figure  3-8,  problems  of  indi- 
cator integration  are  present  on  another  level.  Substan- 
tively different  indicators  must  be  pulled  together  in  a 
single  system.  The  problem  is  compounded  by  the  fact  that 
EWAMS  is  in  a relatively  advanced  stage  of  development  as  a 
political  indicator  system  and  that  DIA/NMIC's  military 
indicator  system  is  at  about  the  same  stage.  Integrating 
these  two  systems  would  be  a massive  task  in  terms  of  con- 
cept, methodology,  classification,  hardware,  and  software. 
Therefore,  for  the  short  term,  it  is  likely  there  will  be 
three  separate  indicator  systems — political,  military,  and 
economic.  Economic  indicators  will  be  developed  and  tested 
outside  the  master  version  of  EWAMS;  the  same  procedure  will 
be  followed  with  military  indicators  based  on  open  source 
data  and  domestic  indicators.  However,  as  these  economic, 
military,  and  domestic  indicator  systems  approach  the  EWAMS 
level  of  development,  they  will  be  integrated  into  its 
master  version. 

For  the  immediate  future,  the  military  and 
political  prototype  warning  systems  will  be  run  in  parallel. 
However,  the  possibility  of  potential  integration  will 
always  be  kept  in  mind  and  used  to  evaluate  any  major 
changes  in  EWAMS  design. 

3.6.2  From  monitoring  to  warning.  There  are  two  major 
components  to  the  problem  of  making  the  transition  from 
monitoring  to  warning.  The  first  is  methodological  and 
involves  setting  indicator  thresholds  and  generating  proba- 
bilities that  produce  hit,  miss,  and  false  alarm  rates  that 
are  both  acceptable  to  the  user  community  and  empirically 
valid.  Resolution  of  this  problem  will  facilitate  solution 
of  the  second — persuading  the  I&W  community  to  use  all  three 
EWAMS  systems  rather  than  just  the  information  retrieval  and 
monitoring  ones. 
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It  is  anticipated  that  as  economic,  military, 
and  domestic  indicators  are  integrated  into  EWAMS , they  will 
initially  be  used  for  monitoring  and  information  retrieval. 
However,  expansion  of  system  capabilities  to  include  warning 
should  be  very  attractive  to  the  analyst.  He  will  be  able 
to  access  information  and  indicators  of  several  types, 
compare  their  signals,  and  use  them  to  interpret  signals 
from  his  other  data  sources.  Given  the  time-sharing  facil- 
ities of  DDF,  the  analyst  will  be  able  to  do  this  even 
before  economic,  military,  and  domestic  indicators  are 
integrated  into  EWAMS.  He  will  be  able  to  access  them  while 
they  are  in  the  stage  of  independent  development  and  testing. 
The  availability  of  these  other  indicators  will  hopefully 
add  impetus  to  analyst  use  of  the  warning  components  of 
EWAMS. 

There  are  two  components  of  EWAMS  design  that 
are  much  farther  downstream  than  indicator  integration  and 
transitioning  from  monitoring  to  warning.  These  are  (1) 
linking  warning  and  operations  functions;  and  (2)  developing 
a concept  called  "intelligent  I&W."  Both  these  topics  are 
discussed  in  Section  7.0. 
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4.0  PROGRESS  ON  THE  DEVELOPMENT  AND  TESTING  OF  AN 
EARLY  WARNING  AND  MONITORING  PROTOTYPE  SYSTEM 


Both  current  and  potential  development  work  has  been 
discussed  in  Section  3.0.  Therefore,  this  chapter  will 
emphasize  testing  methods  and  results. 

4.1  Development  of  the  Early  Warning  and  Monitoring 


Prototype  System 


4.1.1  Current  status.  The  current  status  of  the 
development  of  EWAMS  is  depicted  in  Figure  3-7  and  sum- 
marized in  Figure  4-1.  Briefly,  the  system  is  comprised  of 
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Figure  4-1 

EARLY  WARNING  & MONITORING  SYSTEM  COMPONENTS 


a JCS  regional  scan,  five  quantitative  international  poli- 
tical indicators,  a short-range  forecasting  method,  and  an 
interactive  computer  base.  As  depicted  in  Figure  3-6,  the 
indicators  measure  the  volume  and  variety  of  interactions 
between  or  among  nations.  EWAMS  also  calculates  z-scores, 
deviations  from  normal  or  baseline  behavior,  for  each  in- 
dicator.* Crisis  probabilities  are  generated  from  these 

*These  deviations  are  similar  in  concept  to  the  "un- 
usualness"  measure  of  some  military  indicator  systems. 
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deviations  (Daly  and  Bell  1977b) . Output  from  the  current 
version  of  EWAMS  can  be  found  in  Appendix  A,  and  system 
operation  is  explained  in  the  User's  Manual  (Davies,  1978a). 

4.1.2  Immediate  enhancements.  EWAMS  is  changing 
rapidly — so  rapidly  that  some  of  the  enhancements  listed 
below  may  be  completed  by  the  time  this  report  is  distributed 

• addition  of  the  Event  Frequency  Indicators  (EFI) 
and  Row  Percentages  and  Column  Z-Scores  (ROZ) 
indicators — which  in  turn  will  require  a new  front 
end  for  the  demo; 

• plot  probabilities  and  provide  additional  multi- 
plots ; 

• daily  and  weekly  data  which  will  entail  develop- 
ment of  new  indicators; 

• autoscan  for  the  superpowers; 

• monthly,  weekly,  daily  alert  lists. 

4 . 2 Testing  of  the  Early  Warning  and  Monitoring  Prototype 

System 

The  test  results  reported  below  are  all  based  on  retro- 
spective analysis.  As  is  often  pointed  out  by  those  with 
long  I&W  experience  and  traditional  training — similar,  if 
not  identical,  types  of  problems  do  recur  in  crisis  situa- 
tions so  that  there  is  much  to  be  learned  from  retrospective 
analysis.  Examination  of  historical  indicator  performance 
is  crucial  in  the  attempt  to  develop,  test,  and  threshold 
quantitative  indicators  so  that  they  may  be  used  for  warning. 
However,  if  EWAMS  is  to  be  used  in  an  operational  setting, 
testing  and  evaluation  with  current  daily  data — real-time 
monitoring — are  critical.  Current  daily  updating  of  the 
EWAMS  data  has  just  recently  begun.  The  capability  to  do 
real-time  daily  testing  and  monitoring  will  result  in  ex- 
tensive modification  of  some  indicators  and  development  of 
new  ones;  it  will  expand  the  number  and  kinds  of  input  and 
output  options;  most  important,  it  will  make  EWAMS  more 
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similar  to  extant  military  indicator  systems.  This  will 
facilitate  comparative  testing  of  political  and  military 

2 

indicators  and  acceptance  of  the  system  by  potential  users. 

4.2.1  Quantitative  indicators.  Testing  of  quantita- 
tive indicators  has  focused  on  ROZ , an  indicator  of  single 
country  activity;  on  cooperative  and  conflictual  activity; 
on  comparison  of  political  indicators  with  extant  military 
ones;  and  on  the  tension  measure.  All  these  indicators  can 
be  used  for  both  monitoring  and  warning.  However,  for  the 
indicators  to  be  used  for  warning,  either  thresholds  must  be 
set  or  probabilities  of  crisis  generated  from  them.  Warning 
probabilities  have  been  generated  for  indicators  of  total, 
cooperative,  and  conflictual  activity.  These  are  discussed 
in  Section  4.2.2.  Work  is  continuing  on  setting  thresholds 
for  the  tension  indicator,  and  it  is  likely  that  it  will  be 
the  next  EWAMS  indicator  to  perform  a genuine  warning  function. 
The  tension  measure  and  thresholds  are  discussed  at  the  end 
of  this  section. 

ROZ:  Its  Multiple  Uses'* 

ROZ  (row  percentages  and  column  z-scores)  is  "an 
indicator  for  single  country  performance  that  takes  into 
account  the  country's  weekly  portion  of  the  total  (world) 
action  and  the  extent  to  which  that  portion  is  exceptional 
in  comparison  to  the  ten-year  average"  (McClelland  1976) . 
McClelland  has  demonstrated  the  effectiveness  of  ROZ  as  a 
warning  sign  of  impending  danger,  a monitor  of  on-going 
trouble,  and  as  an  indicator  of  post-crisis  shock.  As  such, 

ROZ  contributes  to  all  three  EWAMS  functions — information 
retrieval,  monitoring,  and  warning.  It  has  been  used  to 


Results  of  daily  real-time  monitoring  and  testing  will 
be  reported  in  forthcoming  research  memoranda. 

3 

This  section  relies  heavily  on  Daly  and  Wittmeyer  (1977) 
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help  determine  what  countries  should  be  added  to  a sample 
for  developing  indicators  of  domestic  conflict  and  linkages 
between  intranational  and  international  conflict  linkages 
(Daly  and  Hopple  1977) . And  it  has  served  as  an  experiment 
to  aid  in  determining  the  standalone  capabilities  of  a 
Tektronix  4051  graphics  terminal. 

The  following  description  of  testing  and  evalua- 
tion of  the  ROZ  indicator  is  a report  on  both  substance  and 
technology.  It  builds  (as  always)  on  McClelland  to  present 
some  interesting  findings  about  ROZ  performance  between 
January  1976  and  March  1977.  In  this  sense  it  is  the  first 
step  in  one  of  our  future  tasks,  i.e.,  to  incorporate  EFI, 
ROZ,  and  dyadic  scans  into  EWAMS.  Since  ROZ's  for  183 
countries  were  generated  with  a standalone  4051  without  a 
host  computer,  the  section  is  also  a report  on  computer 

4 

technology. 


Modified  ROZ:  A combination  of  circumstances 
forced  us  to  slightly  modify  McClelland's  ROZ  calculations. 

To  obtain  ROZ,  he  multiplies  a country's  percent  of  the 
global  activity  for  a given  period  by  its  z-score  for  the 
period  and  adds  a constant,  or 

ROZ  = (Co  % x Co  z)  + 30. 

To  calculate  monthly  ROZ's  for  183  countries  between  January 
1976  and  March  1977,  we:  1)  substituted  percentages  for 
frequencies  in  calculation  of  the  standard  deviation;  and  2) 
rep.aced  a mean  calculated  on  the  frequency  with  McClelland's 
ten-year  average  percent  (McClelland  1976)  in  the  country  z- 
score  calculations.^ 
a 

For  documentation  of  the  program  see  Daly  and  Witt- 
meyer  (1977) . 

5Our  calculations  are  as  follows: 
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Since  the  primary  purpose  of  a workable  ROZ  was 


to  develop  a list  of  countries  which  were  current  and  potential 
sources  of  world  trouble,  tension,  and  threat  rather  than  a 
list  of  those  who  exhibited  this  characteristic  in  the 
decade  preceding  1976,  it  made  sense  to  use  McClelland's 
percent  for  1966-75  as  the  mean.  This  modified  ROZ  would 
not  only  give  us  a reading  on  current  and  potential  sources 
of  trouble,  but  would  also  emphasize  slightly  the  change  in 
a country's  recent  performance  as  compared  to  its  output  in 
the  1966-75  decade.^ 


Although  our  function  is  less  to  do  retrospec- 
tive analyses  of  historical  event  flows  and  their  crises 
than  to  monitor  current  ones  and  to  provide  early  warning  of 
the  crises  embedded  in  them,  knowledge  gained  from  the 
former  is  essential  for  the  latter.  The  top  forty-one  nations, 
in  terms  of  the  average  monthly  percent  of  world  activity 
initiated  between  January  1976  and  March  1977,  are  presented 
in  Table  4-1.  The  table  also  gives  the  rankings  of  the  same 
countries  for  1966-1975  according  to  McClelland's  ten-year 
percent  (McClelland  1976) . Twenty-eight  (68%)  of  the  forty- 

7 

one  countries  in  the  two  lists  are  the  same. 


(Co%  x Co  z)  + 30 
z = x^  - X 


s 

where , 

x.  = country's  monthly  % 

x1  = country's  10-year  % as  in  McClelland  (1976) 

s = standard  deviation  using  % rather  than  frequency 

®This  method,  initially  developed  as  a one-time  analysis 
to  assist  our  judgment  in  increasing  a sample,  worked  so 
well  that  it  might  be  used  as  a substitute  for  McClelland's 
calculations  when  the  analyst  lacks  access  to  a mainframe  or 
the  finances  necessary  to  process  the  very  large  tables 
initially  required  for  McClelland's  ROZ  calculations.  We 
are  in  the  process  of  comparing  the  modified  ROZ  with  the 
original.  Until  then,  however,  a few  interesting  points 
derived  from  a modified  ROZ  are  presented  below. 

7 

The  contribution  the  15-month  rankings  made  to  in- 
creasing a sample  for  developing  and  testing  indicators  of 
domestic  conflict  and  of  intra-international  conflict  linkages 
can  be  found  in  Daly  and  Hopple  (1977) . 

■ 

. 

J 
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McClelland  Rank 
by  Percent 


Rankings 

Average  Z 

1966-1975 

1) 

USA 

19.03 

1(19.2) 

2) 

USR 

5.95 

2(6.9) 

J) 

FLO 

4.32 

14(1.5) 

4) 

UNO 

4.13 

6(4.0) 

5) 

LEB 

4.04 

24 ( . 7 ) 

6) 

1 SR 

3.86 

4(5.7) 

j) 

INK 

3.54 

9(2.5) 

8) 

RHO 

3.38 

>56 ( .2) 

9) 

SYR 

3.37 

18(1.3) 

10) 

UAR 

3.15 

7(3.8) 

11) 

FRN 

2.68 

10(2.1) 

U) 

Z1M 

2.51 

>56 ( .2) 

13) 

SAF 

1.82 

>4X57(.3) 

14) 

ANG 

1.78 

>56 ( .2) 

15) 

CMW 

1.56 

11(2.1) 

lb) 

UGA 

1.48 

>47<57(.3) 

17) 

AJU. 

1.37 

> 56 ( . 2 ) 

18) 

CNN 

1.21 

8(2.8) 

19) 

JAP 

1.13 

17(1.4) 

20) 

CUB 

1.11 

33( . 5) 

21) 

SAU 

1.06 

30 ( .6) 

22) 

LBY 

1.03 

39( . 5) 

23) 

VTN 

.89 

3(6.7) 

24) 

YUC 

.88 

28( .6) 

25) 

2 AM 

.87 

>4  7<  5 7 ( . 3 ) 

2b) 

TUR 

.76 

29( .6) 

27) 

FOR 

.74 

>41<48(.4) 

28) 

1RN 

.70 

38( . 5) 

29) 

CAN 

.66 

20  C .9) 

JO) 

TA2 

.65 

>57 ( .2) 

32) 

JOR 

.65 

16(1.4) 

32) 

IND 

.65 

15(1.4) 

33) 

NIC 

.63 

>41<48(.4) 

34) 

FH1 

.60 

>41<48(.4) 

35) 

EEC 

.59 

26( .6) 

3b) 

GRC 

.57 

36(.5) 

37) 

TAI 

.56 

31 ( . 5) 

38) 

COF 

.52 

> 56 ( . 2 ) 

39) 

SFN 

.52 

>47<57(.3> 

40) 

ALC 

.47 

>41«»8  ( • 4 ) 

41) 

1TA 

.46 

34 ( . 5) 

Table  4-1 

NATION  ACTIVITY  LEVELS 
TOP  41  ( > .45) 

JAN  76  - MAR  77 


lUnkU  ’6-3 


VTS 

5 

67 

CAM 

12 

70 

vcc 

13 

>151 

FAX 

19 

58 

CHE 

21 

67 

KOS 

23 

46 

VAT 

25 

51 

CZE 

27 

62 

IRQ 

32 

54 

KON 

35 

46 

ALL 

37 

78 

RUM 

40 

55 

FOL 

41 

90 

Table  4-2 

CHANGES  IN  NATION  ACTIVITY  LEVELS 
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In  general,  the  differences  between  the  1966-75 


and  the  January  1976-March  1977  lists  are  dramatic  and 
fairly  easy  to  explain.  The  PLO  jumped  from  14th  for  ten 
years  to  3rd  for  the  more  recent  fifteen  months,  reflecting 
its  heightened  recognition  and  its  activity  in  Lebanon,  the 
Middle  East,  and  the  world.  Lebanon  is  also  higher  on  the 
more  current  list,  a reflection  of  its  domestic  strife  and 
the  international  activity  associated  with  the  turmoil.  It 
is  likely  the  move  of  Syria  from  18th  to  9th  is  also  a 
product  of  the  Lebanese  situation  and  Syria's  involvement  in 
it. 

Explanation  of  departures  from  the  decade's  top 
forty-one  would  seem  to  be  a mixture  of  U.S.  disengagement 
in  South  East  Asia  and  a greater  acceptance  of  the  status 
quo  by  Eastern  Europe--or  less  active  resistance  to  it.  The 
thirteen  entities  high  in  activity  from  1966-75  which  disap- 
peared from  the  more  recent  list  (perhaps  to  reappear  when 
ROZ  is  updated  from  April  1977  to  the  present)  are  listed  in 
Table  4-2.  Of  these  thirteen  actors,  the  Koreas  are  the 
most  likely  to  rejoin  the  top  41  in  the  immediate  future. 

As  shown  in  Table  4-1,  Asia  and  Eastern  Europe 
have  been  replaced  by  Africa  on  the  top  forty-one.  At  least 
since  January  1976,  newcomers  to  the  list  are  RHO,  ZIM,  SAF, 
ANG,  UGA,  ARL,  ZAM,  POR,  TAZ , NIG,  PHI,  COP,  SPN,  and  ALG. 

"It  is  conceivable  that  a basic  system  'reorganization'  took 
place"  in  1974  (McClelland  1976:49).  A rough  comparison  of 
ten  years  of  ROZ  with  the  subsequent  fifteen  months  is  not 
sufficient  to  confirm  this.  It  does  reveal,  however,  that 
the  source  of  the  world  event  flow  changed  substantially 
sometime  prior  to  1976.  Further  cross-period  comparisons  of 
ROZ  should  increase  our  understanding  of  any  past  and  ongoing 
system  transformations  as  well  as  enhance  our  early  warning 
capability.  The  above  demonstrates  that  cross-period  com- 
parisons of  ROZ  can  improve  our  monitoring  activities  by 
redirecting  our  focus. 


i 


For  all  countries  except  the  U.S.,  the  ROZ 
danger  threshold  is  50;  the  redline  for  the  U.S.  is  70  (McClelland 
1976:18).  As  illustrated  by  Table  4-3  and  Figure  4-2,  the 
U.S.  ROZ  broke  70  twice  between  January  1976  and  March  1977. 

In  April  1976  the  U.S.  initiated  or  responded  to  activity  in 
such  diverse  locations  as  Somalia,  Lebanon,  and  Rhodesia. 

The  high  ROZ  might  also  be  registering  some  aftershock  of 
Angola  which  crossed  the  danger  line  in  February  and  approached 
it  in  January  (Figure  4-3) . Although  it  did  not  break 
the  redline  of  50,  the  USSR  ROZ  for  April  1976  was  its 
second  highest  in  the  period  (Figure  4-4).  Like  the  U.S., 
it  is  likely  this  is  a reflection  of  Soviet  interest  in 
Somalia,  Lebanon,  and  Angola.  The  high  U.S.  ROZ  for  Feb- 
ruary 1977  precedes  the  Soviet  crossover  to  the  danger  zone 
by  one  month.  It  is  probable  the  former  is  in  part  tracking 
tr.e  Carter  administration's  initiatives  on  such  issues  as 

human  rights  and  SALT  with  the  latter  reflecting  Soviet 
8 

responses . 

The  PLO  broke  50  in  June  and  July  1976  and  came 
fairly  close  in  January  (Figure  4-5)  . The-  "almost"  coin- 
cides with  the  third  highest  Lebanese  ROZ , while  the  June 
high  adumbrates  (as  does  that  for  Syria)  the  July  and  August 
danger  levels  for  Lebanon  (Figures  4-6  and  4-7) . ROZ  thus 
successfully  monitored  the  activity  of  the  three  major 
international  participants  in  the  Lebanese  conflict,  and  the 
June  PLO  and  Syrian  danger  level  readings  could  be  inter- 
preted as  an  early  warning  of  the  subsequent  high  ROZ  for 
Lebanon . 

The  ROZ's  of  five  African  actors  crossed  into 
the  danger  zone  during  the  fifteen  months.  In  addition  to 
Angola,  mentioned  above,  Uganda,  South  Africa,  Zimbabwe,  and 

O 

For  elaboration  and  confirmation  of  this  point,  see 
the  output  for  USR-USA  in  Appendix  A. 
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UNITED  STmTES 


ROZ 


JnH76-M*<R77 


7691 

7602 

7693 

7604 

7685 

7606 

7607 

7608 
7699 
7619 

7611 

7612 
7791 

7702 

7703 


FREOUENCY 

PEPCENT 

Z-SCORE 

93 

14.040 

-0.886 

66 

13.667 

-0.950 

95 

20.386 

0.204 

126 

27.938 

1.501 

117 

19.055 

-0.025 

212 

22.458 

0.560 

76 

11.310 

-1.355 

121 

21.416 

0.381 

1 15 

24.573 

0.923 

45 

12.262 

-1.192 

70 

16.908 

-0.394 

34 

10.119 

-1.560 

73 

17.217 

-0.341 

1 46 

28.460 

1.591 

139 

25.646 

1.107 

ROZ 


17.555 
17.010 
34.154 
71.935 
29.527 
42.567 
14.671 
38. 152 
52.679 
15.385 
23.343 
14.215 
24.  135 
75.272 
58.397 


WG  \ 19.030 
«UG  ROZ  35.267 
SUN  V.  285.454 
NCO  • 19.200 


Table  4-3 


UNITED  STATES 
MONTHLY  ROZ  SCORES 
JANUARY,  1976-MARCH,  1977 
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Rhodesia  broke  50.  Uganda's  July  1976  ROZ  is  a retrospec- 
tive recording  of  the  Entebbe  incident  (Figure  4-8)  . South 
Africa's  high  ROZ  in  September  is  associated  with  riots  and 
turmoil  in  Soweto  and  with  pressure  by  South  Africa  on 
Rhodesia  (Figure  4-9).  The  latter's  highs  in  March,  December, 
and  an  almost  high  in  November,  recorded  the  on-going  conflict 
with  Zimbabwe  and  the  Geneva  negotiations  over  the  future  of 
the  country  (Figure  4-10) . Zimbabwe  crossed  the  danger  line 
in  October  and  approached  it  in  November  (Figure  4-11). 
Illustrating  that  cross-continental  ties  still  exist,  the 
January  1977  ROZ  of  1976  for  UNK  may  partly  reflect  Britain's 
role  in  the  Rhodesian  negotiations  (Figure  4-12) . 

ROZ  seems  to  have  successfully  monitored  and 
pinpointed  the  sources  of  most  of  the  world's  major  dangers 
in  the  fifteen  months  between  January  1976  and  March  1977. 

To  anticipate,  possible  monitoring  failures  might  be  the 
early  phases  of  Angola,  the  Ethiopia-Eritrean  conflict,  and 
the  North  Korean  killing  of  Americans  in  August.  ROZ  does 
seem  to  have  provided  some  warning  of  increased  conflict  in 
Lebanon  and  of  the  heightened  political  tension  between  the 
U.S.  and  Soviets  in  the  first  quarter  of  1977. 

Future  Development  of  ROZ:  The  most  recent 
example  of  the  immediate  future  of  ROZ  is  McClelland's  "TOL 

„ 9 

Monitor  and  Forecast"  of  26  July  1977.  We  intend  to  integrate 
New  York  Times  (NYT) -based  EFI  and  ROZ  into  EWAMS . As 
McClelland  is  doing  with  TOL  (Times  of  London) , the  proto- 
type will  use  EFI,  or  a variant  of  it,  to  track  global  event 
flows.  When  EFI  moves  into  the  danger  range,  ROZ's  will  be 
activated  to  reveal  the  source (s)  of  the  EFI  warnings.  The 
final  and/or  parallel  step  in  assisting  the  analysts'  expertise 
is  the  use  of  dyadic  volume  and  variety  indicators  already 

9 

This  is  information  taken  from  personal  communication. 
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resident  in  the  prototype.  The  relationship  between  these 
indicator  connections  is  illustrated  below: 


Global 

(EFI) 


Individual 

(R02) 


I Early  Warning 

f ,nd 

I Monitoring  Syuam 


That  EFI  can  be  used  on  a regional  as  well  as  a 
global  level  suggests  a variation  on  the  preceding  option. 

Based  on  regional  or  global  EFI  scans  for  threat  conditions, 
the  analyst  will  be  able  to  use  ROZ . If  an  analyst  tracking 
a global  EFI  detected  a change  in  the  nature  and  direction 
of  international  affairs  at  that  level,  he  could  then  drop  to 
a regional  EFI  to  determine  the  region  (or  regions)  respon- 
sible for  the  disturbance  or  he  could  go  directly  to  ROZ  to 
determine  the  specific  country.  Whether  the  analyst  chose  a 
regional  EFI  or  a ROZ  scan,  the  final  step  would  be  to 
locate  the  dyad  (or  perhaps  triad)  generating  the  distur- 
bance. This  global,  regional,  and  individual  country  tracking 
system  will  permit  detection  of  disturbances  long  before 
they  evolve  into  serious  international  crises. 

While  more  work  is  needed  on  both  warning  and 
monitoring  based  on  EFI  and  ROZ  initial  efforts  have  demon- 
strated that  they  can  now  serve  as  useful  monitors.  Their 
dual  functions  will  help  link  the  three  components  of  EWAMS. 

By  using  EFI  as  a global  system  scan  to  lead  into  single 
country  or  dyadic  tracking  rather  than  constantly  tracking  a 
large  number  of  country  pairs,  the  analyst  makes  more  efficient 
use  of  time  and  energy. 

For  analysts  with  regional  concerns,  a modified 
ROZ  could  serve  as  the  basis  of  a weekly  or  daily  ranking  of 
the  most  active  members  of  his  region.  Analysts  with  broader 
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perspectives  might  use  a daily  list  of  the  top  50  ROZ's  or 
percentages  to  monitor  and  forecast  system  displacements. 

ROZ-like  indicators  might  also  be  developed  for  military  and 
economic  data  and  used  in  conjunction  with  the  political  ROZ 
to  further  enhance  our  early  warning  and  monitoring  capa- 
bility. 

Indicators  of  Conflict  and  Cooperation 

A salient  problem  for  a political  indicator 
system  is  that  of  differentiating  among  types  of  crises.  A 
similar  problem  is  that  of  distinguishing  between  exercises 
and  actual  mobilizations.  An  early  warning  and  monitoring 
system  that  could  make  an  even  finer  distinction--between 
"normal"  military  exercises  and  those  conducted  for  poli- 
tical purposes — would  also  be  useful.  Political  indicator 
systems,  whether  run  in  parallel  or  amalgamated  with  com- 
puter-based military  I&W  systems,  should  facilitate  an 
exercise-mobilization  distinction.  For  example,  if  indi- 
cators of  a country's  political  tension  as  well  as  indica- 
tors of  its  military  activity  are  increasing,  there  is  a 
greater  likelihood  that  they  are  signalling  a mobilization 
than  if  only  military  indicators  are  elevated.  Similarly, 
if  only  domestic  political  conflict  indicators  (not  inter- 
national ones)  and  military  indicators  are  rising,  the 
military  activity  may  be  a signal  of  preparation  for  putting 
down  civil  strife  rather  than  for  military  engagement  with 
another  country. 

In  parallel  with  research  on  distinguishing 
between  exercises  and  mobilizations,  whether  with  political 
indicators,  military  indicators,  or  a combination  of  them, 
we  must  continue  work  on  differentiating  among  types  of 
crises — a problem  recently  illustrated  by  the  "crisis  of 
cooperation"  in  the  Middle  East.  An  analysis  of  the  poli- 
tical indicators  of  the  Early  Warning  and  Monitoring  System 
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reveals  little  other  than:  the  nature  of  UAR-ISR  inter- 


action may  have  begun  to  change  in  July;  the  diversity  of 
USA-ISR  interaction  and  a switch  in  the  US-Soviet  relation- 
ship vis-a-vis  the  Mid-East  may  have  contributed  to  the 
change.  While  system  indicators  continue  to  monitor  the 
regional  breakthrough  which  began  in  November  1977,  several 
problems  and  issues  must  be  discussed  before  we  can  deter- 


mine whether  or  not  the  Early  Warning  and  Monitoring  System 
forecasted  the  cooperative  phenomenon. ^ 


Over  the  past  fifteen  years,  the  efforts  of 
those  working  with  WEIS,  other  events  data  sets,  and  with 
crisis  concepts  have  contributed  to  the  development  of 
indicators  which  can  be  used  to  monitor  crises  as  well  as 
international  affairs  in  general.  Research  in  this  field 
has  just  recently  reached  the  point  where  these  indicators 
can  be  evaluated,  thresholded,  and  used  to  forecast  or  warn 
of  crisis.  The  emphasis  in  the  project,  as  well  as  in  the 
work  of  many  who  have  directly  or  indirectly  contributed  to 
it,  has  been  on  conflict  and  crisis.  While  cooperative 
phenomena  are  a component  of  our  indicators,  attention  to 
cooperation  has  been  scant.  Since  we  have  generally  ignored 
historical  cooperation  and  have  done  little  analysis  of  its 
patterns  and  indicators,  we  are  in  no  position  to  set  thresholds 
or  to  provide  advance  warnings  of  major  cooperative  break- 
throughs in  the  affairs  of  nations.  Recent  events  in  the 
Middle  East  have  demonstrated  the  perils  of  our  narrow  focus 
on  conflict.  They  also  illustrate  monitoring  problems  of 
interpretation,  targets,  and  more  general  issues  associated 
with  "crisis."  While  the  impact  of  recent  Middle  East 
events  on  U.S.  national  security  may  not  be  as  dramatic  as 
previous  events,  e.g.,  the  October  War,  they  may  turn  out  to 
be  much  more  important  to  U.S.  defense  policy  in  the  long 


Some  of  these  problems  and  issues  are  also  discussed 
in  McClelland  (1978)  as  what  he  aptly  calls  "the  conflict/ 
cooperation  trap." 
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It  is  likely  there  is  sufficient  information  in 
WEIS  and  other  data  sets  to  develop  various  cooperative 
indicators  and  to  identify  patterns  of  cooperation.  An  un- 
answered empirical  question  is  whether  there  have  been 
enough  "crises  of  cooperation"  to  set  thresholds  for  warning 
and  forecasting.  The  information  is  there;  we  have  not  done 
enough  analysis  to  know  if  we  can  go  from  monitoring  to 
warning  of  cooperative  breakthroughs,  to  know  if  we  can 
solve  the  problems  and  issues  associated  with  different 
types  of  crises. 

Until  recently,  we  considered  cooperative  activ- 
ity solely  in  terms  of  what  it  could  tell  us  about  poten- 
tial for  ongoing  conflict.  Cooperation  has  been  treated 
merely  as  a component  of  other  indicators  of  crisis  and 

conflict.  This  perspective  is  not  wrong,  but  it  is  in- 
12 

complete.  It  is  not  profound  to  say  that  a breakthrough 
in  Middle  East  affairs  occurred  in  November  1977--a  break- 
through which  the  Early  Warning  and  Monitoring  System  re- 
corded accurately.  However,  system  performance  also  revealed 
monitoring  problems  of  targets  and  interpretation  and  the 
issues  associated  with  them.  For  example,  should  intra-Arab 
dyads  be  monitored?  Should  more  attention  be  paid  to  the  UN 
and  PLO?  Should  greater  weight  be  given  to  indicators  of 
superpower-regional  power  interaction  than  to  indicators  of 
regional  power  interaction?  How  much  of  the  US-Israeli 
conflict  signal  is  noise? 


Even  given  these  problems  and  issues,  the  system 
did  monitor  the  November  breakthrough  in  the  Middle  East. 

See  Daly  (1978)  for  a report  of  an  attempt  to  begin 
the  requisite  analysis. 

12 

As  McClelland  discusses  and  as  borne  out  by  our 
research,  cooperation  is  a component  of  crisis  behavior, 
and  probabilities  of  conflict  can  be  generated  from  coopera- 
tive z-scores.  See  McClelland  (1972)  and  Daly  and  Ball 
(1977b). 
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But  more  importantly,  did  these  problems  and  others  prohibit 
a forecast?  Did  the  system  provide  warning  of  the  break- 
through? In  terms  of  the  skeletal  conceptual  relationship 
of  monitoring  to  warning  presented  above,  the  answers  to 
these  two  questions  are  respectively  yes  and  no.  We  have 
not  yet  devoted  sufficient  attention  to  the  evaluation  and 
thresholding  components  of  monitoring  nor  to  the  specific 
issues  associated  with  them.  Thresholds  have  not  been  set; 
patterns  have  not  been  analyzed  for  the  purpose  of  providing 
warning  of  cooperative  breakthroughs  between  nations;  proba- 
bilities have  not  been  generated  for  the  purpose  of  fore- 
casting cooperation.  Yet  while  Monday-morning  quarter- 
backing  may  seem  gratuitous,  if  such  phenomena  are  to  be 
forecast,  history  must  be  searched  for  patterns  which  may 
signal  such  breakthroughs. 

Pre-Crisis  Peaks,  False  Alarms,  and  Conflict 
Event  Types:  Partly  in  response  to  the  problems  revealed  by 
the  analysis  of  the  Mid-East  crisis  of  cooperation,  new 
research  was  undertaken  on  the  cooperative  and  conflictual 
indicators.  Previous  analyses  of  three  crises  that  were 
incorporated  into  the  first-stage  demonstration  system 
revealed  the  presence  of  what  has  come  to  be  referred  to  as 
the  "pre-crisis  peak"  phenomena,  i.e.,  the  tendency  of  the 
system  to  register  a substantial  increase  in  the  probability 
of  a crisis  several  months  prior  to  the  outbreak  of  the 
crisis . ^ 


Pre-crisis  peaks  have  now  been  examined  and 
described  in  three  important  crises:  the  1968  invasion  of 
Czechoslovakia,  the  1971  Indo-Pakistani  War,  and  the  1967 
Sino-Soviet  border  clash.  Analysis  has  focused  exclusively 
on  exchanges  of  conflictual  events  between  country-pairs 

^The  three  crises  included  the  1967  Sino-Soviet  border 
clash,  the  1968  invasion  of  Czechoslovakia,  and  the  1971 
Indo-Pakistani  war.  See  Andriole  (1976B) . 
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during  the  months  preceding  the  crisis.  Attempts  have  been 
made  to  isolate  and  identify  recurring  patterns  in  both 
verbal  conflictual  events  and  physical  conflictual  events. 

The  key  findings  include: 

• pre-crisis  peaks  are  dominated  by  verbal  conflict 
behavior  and  not  physical  conflict; 

• verbal  conflict  and  physical  conflict  indicators 
provide  the  user  with  a more  complete  picture  of 
the  developing  crisis; 

• physical  conflict  indicators  do  not  appear  to 
produce  as  many  false  alarms. 

EWAMS  takes  advantage  of  several  methods  to 
generate  indicators  of  crisis  situations.  Fundamental  to 
the  international  political  indicators  that  measure  volume, 
variety,  tension,  and  uncertainty  is  the  distinction  between 
cooperative  and  conflictual  event  types.  Currently,  event 
types  are  grouped  into  conflict  and  cooperation  categories 
by  using  the  World  Event  Interaction  Survey  (WEIS) . 

In  the  past,  analysts  have  grouped  event  types 

on  the  basis  of  characteristics  other  than  cooperation  and 

conflict.  Different  approaches  to  grouping  events  have  been 

proposed  to  improve  the  monitoring  and  warning  capabilities 

of  the  system  (Andriole  1977b) . Recent  research  with 

events  data  that  categorizes  event  types  by  their  verbal- 

physical  characteristics,  as  well  as  a cooperative-conf lictual 

qualities,  suggests  that  different  groupings  should  be 

14 

investigated  further. 

Of  particular  interest  to  potential  users  are 

research  findings  which  suggest  that  the  character  of  the 

conflict  between  countries  is  substantially  different  in 

n 

See,  for  example,  McGowan  (1976);  Calhoun  (1977);  and 
McClelland  (1970). 
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crisis  and  non-crisis  periods.  Crisis  behavior  has  been 
discovered  to  be  more  sensitive  to  changes  in  physical 
conflict  than  to  fluctuations  in  verbal  conflict.  Further- 
more, analyses  suggest  that  developments  in  verbal  conflict 
tend  to  precede  changes  in  physical  conflict  and  that  these 
developments  often  occur  prior  to  the  outbreak  of  the  crisis 
(Calhoun  1977;  McGowan  1976).  It  has  been  suggested  that 
because  verbal  events  require  less  commitment  and  involve 
fewer  costs  than  do  physical  events,  they  should  follow 
different  patterns."^ 

These  research  efforts  on  conflict  event  types 
are  potentially  quite  valuable.  Above  all  else,  they  sug- 
gest that  monitoring  gross  conflict  levels,  without  taking 
into  consideration  the  verbal-physical  characteristics  of 
the  events,  may  not  be  sufficient.  If  verbal  and  physical 
conflict  interactions  follow  different  but  related  patterns, 
then  the  monitoring  system  is  failing  to  take  advantage  of 
what  may  prove  to  be  highly  diagnostic  pieces  of  information 

From  a warning  perspective,  pre-crisis  peaks  in 
conflictual  interactions  usually  produce  false  alarms. ^ 

This  is  because  pre-crisis  surges  in  conflictual  activity 
occur  at  least  two  months  prior  to  the  outbreak  of  a crisis. 
Additionally,  the  movements  are  typically  dramatic  enough  to 
produce  substantial  increases  in  the  probability  of  a crisis 
Figures  4-13  to  4-15  portray  the  two-way  conflict  interac- 
tion frequencies  along  with  the  conflict  probabilities  for 
the  three  crises.  The  pre-crisis  peak  for  the  1968  Czecho- 
slovakia crisis  occurred  in  May  1968,  three  months  prior  to 
the  invasion  in  August;  the  pre-crisis  peak  for  the  Indo- 

5McGowan  (1976)  . For  a more  complete  discussion  of 
supporting  theory  see  McClelland  (1970)  . 

16A  false  alarm  occurs  when  an  indicator  signals  a 
crisis  during  a month  which  is  neither  a crisis  month  nor  a 
pre-crisis  month  (one  month  before) . See  Daly  and  Bell 
(1977a) . 
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Pakistani  crisis  in  November  took  place  in  April  1971,  seven 
months  prior  to  the  crisis;  and  the  pre-crisis  peak  for  the 
Sino-Soviet  border  clash  of  January-February  1967  occurred 
in  November  of  the  previous  year.^ 

How  can  the  user,  in  a real-time  mode,  determine 
whether  upsurges  in  the  number  of  conflictual  interactions 
and  corresponding  probabilities  reflect  "true"  crisis  situa- 
tions? Obviously,  no  definitive  solution  to  this  problem 
presently  exists.  However,  based  on  the  discussion  of  types 
of  conflictual  events,  it  is  suggested  that  perhaps  addi- 
tional clues  could  be  discovered  by  examining  the  type  of 

conflict — verbal  and  physical — that  produced  the  conflict 

1 8 

increases  and  the  subsequent  false  alarms.  To  explore 
this  possibility,  two  new  conflict  indicators  were  created. 
First,  an  indicator  of  the  frequency  of  verbal  conflict  was 
produced  by  summing  the  number  of  verbal  conflict  interac- 
tions between  the  country-pairs.  The  WEIS  conflict  event 
categories  used  were  reject,  accuse,  protest,  deny,  demand, 
warn,  and  threat.  Second,  a physical  conflict  indicator  was 

produced  following  the  same  procedures  for  the  categories 

19 

demonstrate,  reduce,  expel,  seize,  and  force. 

The  total  number  of  conflictual  interactions 
during  these  three  crisis  periods,  along  with  the  number  of 
verbal  and  physical  conflict  events,  are  given  in  Tables  4-4, 
4-5,  and  4-6.  Several  patterns  are  particularly  worth 
noting. 

^Although  warning  thesholds  for  the  conflict  proba- 
bilities have  yet  to  be  specified,  in  comparison  to  the 
probabilities  for  the  crisis  months  the  pre-crisis  peak 
probabilities  are  high  enough  to  be  considered  warnings. 

1 8 

Sometimes  a further  distinction  is  made  between 
offensive  verbal  conflict  and  defensive  verbal  conflict, 
e.g.,  Kirchner  (1976).  The  usefulness  of  similar  types  of 
categories  for  warning  and  monitoring  purposes  is  presently 
being  investigated. 

19 

Although  these  categories  are  not  created  by  strict 
mathematical  rules,  they  do  fulfill  the  necessary  methodo- 
logical standards  as  well  as  provide  a useful  viewpoint  and 
frame  of  reference  for  the  user. 
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MONTHLY  ACTIVITY 
October  19fc--Sepi ember  1968 
•••USR-»---Two-*«y 


Date 

Conflictual 

Number 

VtTbal  Con 
Number 

Physical  Con 
Number 

Oct  67 

0 

0 

0 

Nov  6 7 

0 

0 

0 

Doc  6? 

0 

0 

0 

Jan  66 

0 

0 

0 

Fob  68 

0 

0 

0 

Mar  66 

0 

0 

0 

Apr  68 

4 

3 

1 

May  68* 

9 

9 

0 

Jun  68 

4 

4 

0 

Jul  68 

24 

19 

5 

Aug  08"  * 

28 

20 

6 

Sep  68 

13 

11 

2 

-pre-crisis  peak 
'•cruii  month 


Table  4-4 

SOVIET  UN  ION  ■♦♦■CZECHOSLOVAK  I A 
TWO-WAY  MONTHLY  CONFLICT  LEVELS 
OCTOBER,  1967— SEPTEMBER,  1968 


MONTHLY  ACTIVITY 
January  19'1-December  1 9 “ 1 
•••IND-m- Two -Hay  Flow----»m*” 


Date 

Conflictual 

Number 

Verbal  Con 
Number 

Physical  Con 
Number 

Jan  71 

0 

0 

0 

Feb  71 

6 

4 

2 

Mar  71 

4 

4 

0 

Apr  71- 

45 

3S 

7 

May  71 

1" 

15 

2 

Jun  71 

0 

0 

0 

Jul  71 

3 

2 

1 

Aug  71 

2 

2 

0 

Sep  "1 

5 

5 

0 

Oct  71 

21 

16 

5 

Nov  71 *• 

55 

34 

21 

Dec  71-- 

198 

14 

184 

•pra-crisis  peak 
••crisis  month 

Table  4-5 

INDIA-*»-PAKISTAN 
TWO-WAY  MONTHLY  CONFLICT  LEVELS 
JANUARY,  1971-  DECEMBER,  1971 


MONTHLY  ACTIVITY 
March  1966-February  19b' 
•••USR— ---Two-Kay  Flo«.----*CHV 


Date 

Conflictual 

Number 

Verbal  Con 
Number 

Physical  Con 
Number 

Mar  66 

9 

9 

0 

Apr  66 

2 

2 

0 

May  66 

5 

5 

0 

Jun  66 

2 

2 

0 

Jul  66 

3 

3 

0 

Aug  66 

9 

7 

2 

Sep  66 

2 

2 

0 

Oct  66 

13 

9 

4 

Nov  66* 

25 

20 

5 

Dec  66 

7 

6 

1 

Jan  6**-- 

20 

14 

6 

Feb  67-- 

32 

21 

11 

•pra-crisis  peak 
••crisis  month 


Table  4-6 

SOVIET  UNION**^CHINA 
TWO  WAY  MONTHLY  CONFLICT  LEVELS 
MARCH.  1966-FEBRUARY,  1967 
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In  each  of  the  pre-crisis  peak  months,  a sub- 
stantially high  proportion  of  the  total  conflict  is  comprised 
of  verbal  conflict  as  opposed  to  physical  conflict.  For 
example,  the  USR-CZE  country-pair  exchanged  nine  conflictual 
events  during  May  1968.  In  comparison  to  previous  levels  of 
conflict  between  the  Soviet  Union  and  Czechoslovakia,  the 
conflict  score  of  nine  was  high  enough  to  register  a proba- 
bility of  .8.  However,  as  the  verbal  and  physical  conflict 
indicators  demonstrate,  all  conflictual  interactions  between 
these  two  countries  during  this  time  period  were  verbal 
conflict  events.  In  other  words,  the  warning  system  esti- 
mated a .8  probability  of  a crisis  in  a month  where  no 
physical  conflict  events  occurred. 

This  same  pattern  also  exists  in  both  the  1971 
Indo-Pakistani  crisis  and  the  Sino-Soviet  border  crisis  of 
1967  (Tables  4-5  and  4-6) . The  pre-crisis  peak  month  of  the 
Indo-Pakistani  crisis  was  April,  when  there  was  an  exchange 
of  forty-five  conflictual  events.  However,  thirty-eight  of 
these  events  or  84%  were  verbal  conflict  events  and  only  16% 
were  physical  conflict  events.  Similarly,  during  the  pre- 
crisis peak  month  of  November  for  the  Sino-Soviet  case  80% 
of  the  twenty-five  conflict  interactions  were  verbal  and  20% 
were  physical. 

The  dynamics  of  the  patterns  in  verbal  and 
physical  conflict  interaction  during  each  crisis  can  be  seen 
in  Figures  4-16  to  4-18.  These  graphs  are  plots  of  the 
three  conflict  indicators  over  time.  It  appears  that  move- 
ments in  verbal  conflict,  with  important  exceptions,  tend  to 
parallel  shifts  in  total  conflict  much  more  closely  than 
does  physical  conflict.  This  is  not  too  surprising  in  light 
of  the  dominating  influence  of  verbal  conflict  on  the  total 
conflict  scores.  However,  it  is  critical  to  take  notice  of 
th-'se  situations  in  which  physical  conflict  tends  to  parallel 
» til  conflict,  namely  in  crisis  months.  In  other  words, 
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physical  conflict  events  appear  to  reflect  the  developing 
crisis  situations  quite  accurately.  Whereas  verbal  conflict 
events  increase  dramatically  during  pre-crisis  peaks,  pro- 
ducing subsequent  false  alarms,  physical  conflict  events  do 
not. 

Future  Research  on  Conflict  Indicators:  The 
preliminary  results  from  this  exploratory  research  effort 
are  very  encouraging  for  a number  of  reasons.  First,  the 
findings  strongly  suggest  that  quantitative  political  indi- 
cators of  crisis  situations  derived  from  characteristics  of 
events  other  than  cooperation  and  conflict  could  prove  to  be 
quite  valuable.  In  addition  to  examining  the  verbal-physical 
qualities  of  conflictual  events,  it  is  also  possible  to 
examine  cooperative  events  in  a similar  manner.  Second,  the 
findings  indicate  that  perhaps  a wider  variety  of  information 
needs  to  be  considered  before  crisis  warnings  are  given. 

One  alternative  may  be  to  provide  the  user  with  different 
types  of  warnings  depending  on  the  type  of  conflict  being 
exchanged.  Another  possibility  is  that  an  "intelligent" 
warning  system  could  automatically  produce  verbal  and  physical 
conflict  events  when  the  conflict  probability  crosses  a 
certain  threshold. 

Several  questions  need  to  be  considered  in 
future  research.  For  example,  how  might  separate  indicators 
of  verbal  and  physical  conflict  specifically  enhance  the 
monitoring  and  warning  capabilities  of  the  system?  How 
often  are  pre-crisis  peaks  produced  as  a result  of  verbal 
conflict  in  other  crises?  What  about  those  crises  that  are 
not  preceded  by  premature  increases  in  conflictual  inter- 
actions? If  changes  in  verbal  conflict  tend  to  precede 
changes  in  physical  conflict,  how  can  this  findim  be  used 
to  improve  warning  time?  Do  crisis  warnings  based  on  physical 
conflict  interactions  reduce  the  number  of  false  alarms 
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without  increasing  misses?  We  are  currently  exploring 
several  of  these  possibilities.*^ 

Military  Indicators 


. 


The  design  for  use  and  integration  of  military 
indicators  into  EWAMS  is  discussed  in  Section  3.0.  Unfor- 
tunately, much  of  the  research  done  under  the  terms  of  the 
ARPA/DIA  MOU  and  with  the  great  cooperation  of  DIA/NMIC 
personnel  is  classified  and  cannot  be  reported  in  detail 
here.  However,  a few  summary  statements  can  be  made. 

Since  the  inception  of  the  ARPA/CTO  EWAMS  pro- 
ject, the  assumption  has  been  that  political  indicators  will 
provide  earlier  warning  of  international  crises  than  will 
military  indicators.  The  reasoning  has  been  that  conflict, 
tension,  and  uncertainty  characteristics  of  a crisis  will 
appear  in  the  political  arena  before  activity  in  the  military 
sphere  begins  to  deviate  from  the  norm,  if  indeed  it  does. 

It  has  been  presumed  that  in  most  cases  (successful  surprise 
attacks  being  the  obvious  exception) , those  national  decision- 
makers who  control  the  use  of  force  will  (intentionally  or 
unintentionally)  reveal  their  plans,  or  the  potential 
results  of  their  interactions  will  appear  in  the  political 
arena  before  the  military  is  activated. 

The  results  of  other  research  related  to  this 
proposition  are  mixed.  A study  of  four  military  and  many 
international  political  indicators  over  five  and  one-half 
years  found  "some  evidence  of  consistent  and  significant 
relationships"  between  the  two  sets,  with  military  ones 
tending  to  lead  political  ones  (Calhoun,  Weil,  and  Kry- 
sakowski  1974) . A study  of  one  year  (12/71-12/72)  of  poli- 
tical and  military  interaction  among  North  and  South  Vietnam 

20 

Results  of  tests  addressing  these  questions  will  be 
reported  in  forthcoming  research  memoranda. 
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and  the  U.S.  found  a variety  of  associations  among  con- 
current and  lagged  political  and  military  indicators.  The 
study  was  not  intended  as  an  analysis  of  warning  time 
provided  by  the  indicators  but  rather  as  a description  of 
the  interaction  among  the  three  countries  (CACI  1973) . 

Among  the  strongest  associations  were  those  between  U.S. 
attacks  on  North  Vietnam  and  on  North  Vietnamese  troops  and 
political  hostility  from  North  Vietnam  to  the  U.S.  The 
association  held  for  both  the  same  week  and  with  a lag  of 
U.S.  attacks  from  1-4  weeks  behind  North  Vietnam  political 
behavior  (CACI  1973) . There  are  several  unique  features  of 
the  Vietnam  study  which  prohibit  generalization  of  its 
findings.  However,  the  first  study  used  indicators  and 
actors  fairly  similar  to  those  examined  in  our  work  at 
DIA/NMIC.  That  the  findings  of  that  study  generally  con- 
tradict our  assumptions  is  one  of  several  reasons  for  our 
ongoing  effort. 

The  purpose  of  preliminary  research  is  primarily 
to  compare  the  trends  in  political  and  military  indicators 
over  a period  of  time,  to  look  for  similarities  and  differences 
in  the  way  they  monitor  international  activity.  A secondary 
purpose  is  to  compare  their  warning  performance  and  the 
leads  and  lags  between  the  two  types  of  indicators. 

Very  preliminary  results  suggest  that  military 
and  political  indicators  are  most  strongly  associated  (and 
monitoring  is  most  congruent)  in  crisis  periods.  Further- 
more, the  assumption  that  political  indicators  lead  military 
ones,  while  not  disconf irmed , is  far  from  validated.  The 
authors  of  the  CACI  study  which  found  that  military  indica- 
tors led  political  and  military  indicators  for  periods  of 
several  years,  both  concurrent  and  lagged,  are  also  counter- 
intuitive. 
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To  date,  conclusions  of  an  infant  effort  are 
both  substantive  and  methodological.  Political  and  military 
indicators  can  be  used  to  monitor,  and  to  some  extent  provide 
warning  of,  major  international  crises.  Methodologically, 
there  are  many  problems  and  potential  solutions.  While 
solutions  may  not  validate  our  assumptions,  hopefully  they 
will  enable  us  to  better  understand  the  behavior  of  and  the 
relationships  between  political  and  military  indicators.  We 
must  specify  the  best  political  indicators  to  be  used  for 
comparison.  Perhaps  verbal  political  conflict  may  be  more 
appropriate  than  total  political  activity  or  conflict  in 
general.  We  must  also  manipulate  the  political  data  so  that 
it  is  as  comparable  as  possible  to  the  military  data  format. 

Tracking  the  political  indicators  for  the  same 
time  spans  as  military  indicators  in  their  original  form, 
whether  weekly,  daily,  or  bi-weekly,  may  reveal  stronger 
associations  between  the  concurrent  and  lagged  values. 

While  military  indicators  are  usually  based  on  very  rich 
data,  the  political  data  currently  in  use  is  best  for  the 
U.S. -Soviet  pair,  which  also  has  the  strongest  association 
with  the  military  indicators  examined  so  far.  If  other 
military  indicators  track  other  countries,  country-pairs  or 
regions,  other  political  data  sets  could  be  used.  In  any 
case,  a pilot  study  comparing  public-source-based  political 
indicators,  political  indicators  based  on  possibly  richer 
cable  traffic,  and  military  indicators  might  be  one  means  of 
bringing  to  convergence  our  assumptions  and  findings  about 
the  relationship  between  political  and  military  indicators 
for  forecasting  and  monitoring. 

21 

Tension  and  Thresholds 
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There  have  been  three  thrusts  in  the  research  on 

the  international  tension  measure:  (1)  modification  and 


This  section  relies  heavily  on  Daly  and  Bell  (1977a)  . 
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improvement  of  the  basic  algorithm;  (2)  examination  of 
region-specific  tension  indicators,  and  (3)  exploration  of 
warning  thresholds  for  the  indicator. 


Results  of  the  research  presented  below  are 

based  on  twenty-five  "global"  crises  which  occurred  between 

1966-1975.  Tension  levels  in  these  crises  were  altered  with 

several  weighting  factors,  and  associations  between  indicator 

signals  and  reality  were  calculated  not  only  for  the  weighted 

tensions  across  twenty-five  crises  but  also  for  various 

warning  thresholds  for  each  weight.  In  conjunction  with 

this  research,  two  interactive  programs  for  weighting  tension 

and  for  calculating  indicator-reality  associations  were 

22 

developed  on  a standalone  Tektronix  4051.  The  key  findings 
are  listed  below. 


• Across  twenty-five  crises,  a tension  weighted  by 
1/f  has  the  strongest  association  with  historical 
reality;  unweighted  tension  has  the  weakest. 

• A warning  threshold  of  70  has  the  highest  associa- 
tion for  this  1/f  weighted  tension. 

• The  indicator-reality  association  calculation  (and 
standalone  interactive  program)  can  be  generalized 
to  test  other  I&W  indicators. 

• The  weighted  tension  algorithm  most  useful  for 
general  warning  and  monitoring  purposes  will  not 
necessarily  yield  hit/false  alarm  rates  best 
suited  to  the  requirements  of  the  user  community. 

Hit  and  false  alarm  rates  can  be  calculated 
for  any  threshold  and  any  weight.  The  analyst 
must  then  choose  that  mix  of  rates  which  best 
meets  the  requirements  of  his  responsibility. 


Method--Tension : The  tension  indicator  reflects 

the  percent  of  total  events  sent  and/or  exchanged  that  are 
cooperative  and  conflictual.  It  ranges  from  0 to  100  and  is 

2 2 

Both  programs  were  written  by  Brenda  Bell. 
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used  to  monitor  international  relations.  Increases  in  the 

tension  indicator  are  used  to  provide  warning  of  potential 

conflict  and  danger  and,  once  a crisis  has  begun,  to  monitor 
23 

its  status.  Prior  to  the  research  reported  in  this  section, 
tension  was  calculated  as  follows: 


CONFLICTUAL  BEHAVIOR  (CON) 
DENOUNCE 
ACCUSE 
THREATEN  . . 


COOPERATIVE  BEHAVIOR  (CO) 
PROPOSE 
AGREE 
PRAISE  . . 


TENSION  - 


CON  - CO 
CON  ♦ CO 


X 50 


A more  straightforward  restatement  of  the  algorithm  was: 

TENSION  » x 100 

This  calculation  for  tension  controlled  for  the 

total  number  of  events  occurring  in  a time  period,  e.g., 

both  10  and  100  events  could  yield  tension  levels  of  80.  It 

was  suggested  that  the  reliability  of  tension  decreased  with 

the  number  of  events.  In  addition  to  questionable  reliability, 

tension  levels  based  on  small  frequencies  tended  to  vary 

erratically.  For  instance,  when  there  were  less  than  ten 

events,  tension  tended  to  equal  0,  50,  or  100  and  to  change 

100  points  from  one  month  to  the  next.  Finally,  ".  .to 

fine-tune  tension  and  to  make  it  less  dependent  on  the  size 

of  f,  some  weighting  method  or  ’correction’  factor  needed  to 

24 

be  introduced  into  the  calculation."  Now  tension  is 

23 

For  more  background  on  the  deviation  and  concept  of 

tension,  see  Andriole  (1976a  and  1976b) . For  illustrations 

that  the  tension-conflict  association  is  far  from  a novel 

idea,  see  Holsti  (1973  and  1963) . 

24 

For  the  source  of  these  suggestions  see  Parker 

(1977)  . 
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viewed  as  a function  of  both  the  predominance  of  conflict 
events  compared  to  cooperative  and  the  total  number  of 
events.  The  earlier  tension  measure  assumed  that  tension 
depended  strictly  on  the  former  consideration. 

The  first  cut  at  correcting  tension  was  reported 
in  Research  Memorandum  #9  and  was  based  on  the  following 
two-way  flows  and  crisis  periods: 

ISR-UAR  1/67-12/67  and  1/73-12/73 

ISR-SYR  1/67-12/67  and  1/73-12/73 

ISR-JOR  1/67-12/67  and  1/73-12/73 

ALL-ALL (Middle  East) 1/67-12/67  and  1/73-12/73. 

2 

The  initial  weighting  factors  used  were  1/f,  l/2f,  1/f  , 
and  1/f+l.  An  example  of  the  calculation  to  weight  tension 


Tencorrected  = Tenraw  ' (Te"ra,  x 1/£  > 


In  all  cases  the  weighting  factor  was  subtracted  in  order  to 
reduce  tension  scores  based  on  small  f's  and  to  have  little 
effect  on  those  based  on  large  f's  (Parker  1977). 


In  order  to  determine  if  the  first  cut  results 

were  reliable  and  generalizable , we  expanded  the  sample  from 

eight  regional  cases  in  two  crisis  periods  to  twenty-five 

25 

"global"  crises  occurring  between  1966-1975.  These  cases 
are  listed  in  Table  1.  We  used  the  same  weighting  factors 
and  also  subtracted  them  to  reduce  tension  scores  based  on 
small  f's. 


The  larger  sample  yielded  a general  and  reliable 
tension  algorithm  which  has  been  incorporated  into  the 


(1977)  . 


’For  caveats  connected  with  "global"  see  Daly  and  Bell 
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master  demonstration  system  of  the  Early  Warning  and  Moni- 
toring System.  It  is  quite  possible  that  a region-specific 
tension  algorithm  will  differ  from  the  general  one  based  on 
twenty-five  crises.  This  possibility  is  analyzed  below  by 
using  more  Middle  East  crisis  periods  and  country  pairs  than 
were  used  in  the  first  cut  at  correcting  tension.  If  it  is 
found  that  certain  regions  are  more  accurately  monitored 
with  tension  algorithms  differing  from  the  general  one,  an 
option  will  be  added  to  the  system  to  allow  the  analyst  to 
use  the  general  one  or,  depending  on  his  focus,  to  use  a 
region-specific  one. 

Method — Association  Between  Indicator  Signals 
and  Historical  Reality:  A multi-method  approach  was  employed 
to  evaluate  the  utility  of  alternative  weighting  factors. 
First,  Yule's  Q;  second,  overall  success  rates;  and  third, 
percentages  for  the  possible  outcomes.  Testing  of  the 
weighted  tension  measures  were  generated  by  a standalone 
interactive  program  which  is  generalizable  to  other  indi- 
cators. The  Yule's  Q statistic,  a measure  of  association 
for  two  by  two  tables  was  used  (Leege  & Francis  1974;  Watts 
& Wilcox  1966) , to  compare  the  warning  and  monitoring  capa- 
bilities of  the  weighting  tension  levels.  Yule'r,  Q is 
calculated  as  follows: 


REALITY 


Indicator 

Signals: 


Crisis 

No  Crisis 

Crisis 

a 

b 

(Hitl 

(F*Im  Al*rm) 

No 

Crisis 

c 

(Miul 

d 

(Correct  R»|»cttOnl 

with  the  cells  defined  as: 


; 
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HIT  When  the  indicator  signalled  crisis  either  during 

the  crisis  month  or  one  month  before  the  crisis 
began . 

MISS  When  the  indicator  did  not  signal  crisis  during 

the  crisis  month  or  one  month  before  the  crisis. 


FALSE  When  the  indicator  signalled  crisis  during  a month 

ALARM  which  was  neither  a crisis  month  nor  a precrisis 
month  (one  month  before) . 

CORRECT  When  the  indicator  did  not  signal  crisis  and  there 
REJECTION  was  no  crisis  during  the  month. 


Yule’s  Q varies  from  -1  to  +1  with  the  best 
weighting  factor  yielding  the  highest  positive  value.  A 
+1.0  means  there  is  a perfect  linear  association  between 
what  the  indicators  have  signalled  and  reality.  That  is,  if 
the  indicators  accurately  record  all  hits  and  correct  rejec- 
tions, Q=+l . 0 . A -1.0  suggests  there  is  a negative  rela- 
tionship between  the  indicator  signals  and  reality,  i.e., 
they  have  always  missed  or  false  alarmed.  There  are  some 
caveats  to  be  offered,  especially  when  the  analyst  is  cal- 
culating Q over  a small  number  of  cases.  If  there  are 
either  no  false  alarms  and  some  misses,  or  vice  versa,  Q 
will  still  equal  1.0.  ^ 


Since  some  analysts  will  prefer  to  work  with  and 

to  evaluate  the  indicators  in  terms  of  percentages  of  hits, 

misses,  and  false  alarms  rather  than  an  overall  association 

between  reality  and  indicator  signals,  the  program  will  also 

calculate  these  percentages  over  crises  of  the  analyst's 

choice. 

— 

Counts  of  hits,  misses,  and  false  alarms  take  into 
consideration  the  one-month  period  prior  to  the  crisis. 

Since  our  intention  is  to  eventually  monitor  on  a weekly  and 
daily  basj.s,  we  feel  that  one  month's  lead  is  both  adequate 
and  realistic. 

27 

The  program  quickly  displays  a table  which  the  analyst 
can  examine  to  determine  if  a Q = 1.0  is  reflecting  perfect 
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Results--Associations ; The  Yule's  Q for  various 
weights  and  warning  thresholds  across  twenty-five  crises  are 
presented  in  Table  4-7.  Unweighted  tension  has  the  weakest 
Yule's  Q,  while  tension  weighted  with  1/f  has  the  strongest. 

As  will  be  discussed  in  detail  below,  it  also  has  the  highest 
percentage  of  hits  and  correct  rejections.  Tension  levels 
weighted  by  this  factor  have  been  incorporated  into  the 
master  version  of  the  demonstration  system.  The  new  algo- 
rithm is: 

TENSION  - 


Or,  more  simply: 


TENSION 


CON 

TOT 


x 100 


Some  idiosyncracies  of  this  algorithm  include: 


• TEN  = 0 when  there  are  0 events; 

• TEN  = 0 when  there  is  one  event  and  it  is  coop- 
erative; and 

• TEN  has  been  hardwired  to  28  when  there  is  one 
event  and  it  is  conflictual. 


For  a 1/f  weighted  tension,  a warning  threshold  of  70  has 
the  highest  association  with  historical  reality  (.599).  As 
will  be  indicated  shortly,  more  work  has  been  and  needs  to 
be  done  on  thresholds  and  hit/false  alarm  rates  for  tension 
as  well  as  other  indicators.  In  the  interim,  a tension 
level  of  70  might  serve  as  a useful  reference  point  for 
analysts . 

The  impact  of  weighting  tension  can  be  illus- 
trated by  a comparison  of  the  old  and  new  algorithms  for 

accuracy  of  the  indicators  or  0 in  the  false  alarm  or  miss 
cells.  Analyses  carried  out  for  twenty-five  crises  suggests 
that  a high  negative  Yule's  Q usually  indicates  a high  false 
alarm  rate  rather  than  many  misses. 
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PROCESSING. . . 

• 

JOP  -N-.  V V-ivp 

JAN 

1966 

- 

DEC 

1966 

jORv < v ’ FLO 

JmN 

I 966 

- 

DEC 

1 966 

JOR-.  n < '* '/  v I SP 

JAN 

1967 

- 

DEC 

1967 

I SP-.  \<  1 1 >SVP 

JAN 

1967 

- 

DEC 

1967 

I SR<  < < >>  >UmP 

JmN 

1967 

- 

DEC 

1967 

J0P<<O>  - ISP 

SEP 

1967 

- 

AUG 

1968 

isp<  •:<;  '•■•‘•uhp 

JmN 

1969 

- 

DEC 

1969 

ISR<<<>>>SYP 

JmN 

1 969 

- 

DEC 

1969 

J0P'.S<  >> >SYR 

JAN 

1970 

- 

DEC 

1970 

JOP‘.<<  >>>PL0 

JAN 

1970 

- 

DEC 

1970 

ISP'.<-:  ">  syp 

JAN 

1970 

- 

DEC 

1970 

U$<K«»7SM? 

JAN 

1970 

- 

DEC 

1970 

ISR<<s>>>UAR 

JAN 

1973 

- 

DEC 

1973 

ISR<<<  > > 'SYR 

JMN 

1973 

- 

DEC 

1973 

usr-:<o>>uSh 

JAN 

1973 

- 

DEC 

1973 

USR<  <<  >>  >CHN 

AUG 
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- 

JUL 

1 967 

GRC<  < < >>  >TUR 

JAN 

1967 

- 

DEC 

1967 

TUR<<<'  >>>CYP 

JAN 

1967 

- 

DEC 

1967 

USR<<<  >>>C2E 

JAN 

1968 

- 

DEC 

1968 

USA<  < < >> >KON 

AUG 

1967 

- 

JUL 

1968 

USR<<<  >>>CMN 

JAN 

1969 

- 

DEC 

1969 

U$A<  <<  > > >USR 

JAN 

1970 

- 

DEC 

1970 

lND<<0>>PAk 

JUN 

1971 

- 

MAY 

1972 

GRC<<<'  >>>TUR 

JAN 

1974 

- 

DEC 

1974 

TUR<<<  >>>CYP 

JAN 

1974 

DEC 
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,'ULE  S 0 FOP  TENSION 


Crisis 

Threshold 

Raw 

Tension 

1-  F 

1'2F 

1/FF2 

l'f*l 

Awcrate 

90 

0.435 

0.554 

0.455 

0.580 

0.496 

0.504 

85 

0.495 

0.574 

0.559 

0.466 

0.532 

0.525 

80 

0.459 

0.496 

0.456 

0.492 

0.538 

0.488 

75 

0.491 

0.537 

0.527 

0.520 

0.527 

0.520 

70 

0.482 

0.599 

0.490 

0.461 

0.544 

0.515 

Average 

0.473 

0.552 

0.498 

0.504 

0.528 

0.511 

Table  4-7 

YULE'S  Q FOR  TENSION  OVER  25  CRISES 
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three  crisis  cases.  Table  4-8  shows  the  old  or  unweighted 
algorithm  under  "TENSION,"  the  total  number  of  events  on 
which  the  calculation  is  based,  and  the  effect  of  weighting 
by  one  divided  by  the  total  for  India-Pakistan . The  crisis 
months  were  November-December  1971,  and  the  first  observa- 
tion on  the  columns  is  June  1971.  The  weighted  tension  is 
generally  lower  and  less  erratic  than  the  unweiahted. 

Both  indicators  Drovide  warnina  of  and  monitor  the  crisis. 
However,  weiahted  tension  is  not  characterized  bv  the  ex- 
treme scores  of  100  in  Julv  and  Auaust  (based  respectively 
on  onlv  three  and  two  events)  which  appear  in  the  unweighted 
tension  and  which,  since  they  were  followed  by  a 30-point 
drop  in  one  month,  might  have  led  an  analyst  to  believe  that 
potential  conflict  had  been  averted. 

Table  4-9  encompasses  the  Soviet-Chinese  border 
dispute  of  January-February  1967.  Weighted  tension  is  lower 
and  more  consistent  than  unweighted.  Both  tensions  warn  of 
and  monitor  the  crisis  period,  while  weighted  is  much  better 
at  recording  the  winding  down  of  the  confrontation  with  its 
smaller  number  of  events. 

Neither  the  weighted  nor  the  unweighted  tension 
for  the  Soviet  invasion  of  Czechoslovakia  broke  the  recommended 
warning  level  of  70  in  the  crisis  year  (Table  4-10)  . While 
the  tension  algorithms  fail  in  this  specific  case — a result 
of  the  relatively  large  percentage  of  cooperative  events  in 
the  period  which  perhaps  reflect  Soviet  deception  and  Czech 
attempts  to  avoid  and  then  mitigate  USSR  action — this  should 
not  be  viewed  as  a failure  of  the  tension  indicator  in 
general.  The  Yule's  Q average  for  twenty-five  cases  indicates 
that  tension  can  be  a useful  and  revealing  indicator  for 
monitoring  and  warning.  It  would  be  possible  to  develop 
dyad-specific  tension  algorithms  which  would  work  for  his- 
torical cases.  However,  since  many  country-pairs  have  been 
involved  in  only  one  crisis,  e.g.,  USR-CZE,  this  would  mean 
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fill  TENSION  LEUELS  tttt 

JUN  1971  - HAY  1972 

1N0‘.  < < > »PAK 

Total 

ConTI tc tual 

Tension 

1, 

e 

0 

30.000 

3 

3 

100.000 

2 

2 

tee. eee 

7 

3 

71.429 

22 

21 

93.435 

60 

35 

91.667 

210 

190 

90.026 

10 

3 

30.000 

17 

8 

47.039 

f ' 

10 

9 

90.000 

17 

1 

3.882 

8 

4 

30.000 

Tension 

F 

1/2T 

l/#t2 

!/#♦! 

30.000 

0 

e.eee 

e.eee 

e.eee 

e.eee 

100. 000 

3 

66.667 

83.333 

88.889 

73.000 

100. 000 

2 

30.000 

73.000 

75.000 

66.667 

71.429 

7 

61.224 

66.327 

69.971 

62.300 

93.455 

22 

91.116 

93.283 

93.257 

91.304 

91.667 

60 

90.139 

90.903 

91.641 

90. 164 

90.026 

210 

90.409 

90.617 

90.824 

90.411 

30.000 

10 

27.000 

28. see 

29.700 

27.273 

47.059 

17 

44.291 

43.673 

46. 896 

44.444 

90.000 

10 

81.000 

83.300 

89. 100 

01.818 

3.682 

17 

3.336 

3.709 

3.862 

5.336 

30.000 

0 

43.750 

46.073 

49.219 

44.444 

Table  4-8 

INDIA-**- 

PAKISTAN 

MONTHLY  TENSION  LEVELS 

L ' 

JUNE,  1971 

-MAY,  1972 

**?»  TENSION  LEUELS  **** 

AUG  1966 

- JULY  1967 

USR<<0>>CHN 

Total 

Confl ic  tual 

Tension 

10 

9 

90.000 

2 

2 

tee. eee 

14 

13 

92.857 

26 

25 

96.134 

7 

7 

100. 000 

20 

20 

100.800 

35 

32 

91.429 

9 

9 

lee. eee 

4 

3 

75.000 

4 

4 

180.000 

3 

3 

100. 000 

3 

3 

100.000 

Tension 

F 

l'2f 

l*'Ft2 

l/f4l 

90.000 

10 

81.000 

83.300 

89. 100 

81.818 

100.000 

2 

30.000 

73.000 

73. 000 

66.667 

92.837 

14 

86.224 

89.541 

92.383 

86.667 

96.  154 

26 

92.456 

94.303 

96.012 

92.393 

106. 000 

7 

83.714 

92.857 

97.939 

87.300 

100. 000 

20 

93.000 

97.300 

99. 730 

95.238 

91.429 

33 

08.816 

90. 122 

91.354 

88.889 

100. 000 

9 

88.889 

94.444 

98.765 

90.000 

73.000 

4 

36.238 

63.623 

70.313 

60.000 

■ 

100. 000 

4 

73.000 

87.300 

93.730 

00. 000 

100. 000 

5 

80.000 

90.000 

96.000 

03.333 

100.000 

1 i" 

3 

66.667 

83.333 

88.089 

73.000 

Table  4-9 


SOVIET  UNION«**CHINA 
MONTHLY  TENSION  LEVELS 
AUGUST,  1966— JULY,  1967 
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tttt  TENSION  LEVELS  tttt 
JHN  1968  - DEC  1968 


USR<<<  >>>CZE 

Total 

Conf 1 ic  tual 

Tension 

1 

0 

0.000 

•> 

w 

0 

0.000 

5 

8 

0.000 

8 

4 

50.000 

21 

9 

42.857 

12 

4 

33.333 

37 

24 

64.865 

48 

28 

58.333 

41 

13 

31.707 

21 

5 

23.810 

11 

-* 

r 

63.636 

10 

2 

20.000 

Tension 

F 

l'f 

l/2f 

l/ft2 

l/f+1 

0.008 

1 

0.000 

0.000 

0.0O0 

0.000 

0.000 

2 

0.000 

0.000 

0.000 

0.000 

0.000 

5 

0.000 

0.000 

0.000 

0.000 

50.000 

8 

43.750 

46.875 

49.219 

44.444 

42.857 

21 

40.816 

41.837 

42.760 

40.909 

33.333 

12 

30.556 

31.944 

33. 102 

30.769 

64.865 

37 

63.112 

63.988 

64.817 

63. 158 

58.333 

48 

57.118 

57.726 

58.308 

57. 143 

31.707 

41 

30.934 

31.321 

31.688 

30.952 

23.810 

21 

22.676 

23.243 

23.756 

22.727 

63.636 

11 

57.851 

60.744 

63.110 

58.333 

20.000 

10 

18.000 

19.000 

19.800 

18. 182 

Table  4-10 

SOVIET  UNION***-CZECHOSLOVAKIA 
MONTHLY  TENSION  LEVELS 
JANUARY-DECEMBER,  1968 
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generalizing  from  one  case.  A tension  algorithm  based  on  as 
large  a sample  as  possible  will  be  more  reliable  and  valid 
for  a monitoring  and  warning  system  which  is  both  global  and 
"real  time." 

Results — Hit/False  Alarm  Rates:  For  the  analyst 
interested  in  general  warning  and  monitoring,  who  is  not 
interested  in  empiricially  established  thresholds  but  who 
would  rather  base  them  on  his  own  expertise,  1/f  weighted 
tension  is  the  most  reliable  tension  indicator.  As  indi- 
cated in  Table  4-11,  the  weight  has,  when  calculations  are 
over  several  thresholds,  the  highest  percentage  of  "successes" 

(Hit  + Correct  Rejection  = 75.87%).  For  the  analyst  in- 
terested in  a general  reference  threshold  with  the  strongest 
association  with  historical  reality,  Table  4-12  illustrates 
that  70  for  1/f  is  preferable,  based  upon  a success  rate  of 
73.33%. 

L 

However,  the  responsibility  of  some  analysts 
might  dictate  a greater  concern  with  false  alarm  percentages 
than  with  general  associations  of  indicator  signals  and 
reality.  For  those  analysts,  other  weight-threshold  com- 
binations might  be  more  suitable.  While  the  1/f  weighted 
tension  with  a 70  threshold  has  both  the  highest  Yule's  Q 
and  the  highest  success  rate,  this  is  not  always  the  case 
for  other  thresholds.  Furthermore,  the  responsibilities  of 
some  analysts  might  render  a false  alarm  rate  of  17.67 
unacceptable.  For  these  analysts,  Table  4-13  presents  some 

alternatives.  While  the  general  overall  performance  of  a 90 

2 

threshold  and  weights  of  1/f  or  1/f  are  not  as  strong  as  70 
and  1/f,  they  do  reduce  the  false  alarm  percentages  and 
increase  the  sum  of  hits  and  correct  rejections  (79.0  and 
76.34  respectively).  Part  of  the  price  for  this  is  a reduc- 
tion in  hits  and  an  increase  in  misses. 
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»*♦  YULE'S 

0 FOR  TEHSIOH  MS 

CRISIS 

THRESHOLD 

RAH 

TENSION 

I/-F 

1'2F 

t'FM2 

\'f*\ 

AUCRACS 

90 

0.433 

0.334 

0.433 

0.300 

0.496 

9.304 

83 

0.  493 

0.374 

0.339 

9.’ 466 

9.332 

0.323 

80 

0.43* 

0.496 

0.436 

9.492 

0.330 

9.409 

73 

0.491 

0.537 

0.327 

0.320 

0.327 

9.320 

70 

0.482 

0.399 

0.490 

9.461 

9.344 

0.313 

AVERAGE 

0.473 

0.332 

0.498 

0.394 

9.328 

0.31t 

False 

Alar* 

28.  735; 

12.205; 

17.475; 

19.33% 

14.13% 

Hus 

7.335; 

11.935; 

10.60% 

9.07% 

11.47% 

Hit 

Corrcc  t 
Rcjec  t ion 

1 1 . 47%v 

ti.my 

32.27);' 

7.0?%v 

7S.»7X> 

60.00%' 

8 . 405;  v 

63.33%'' 

Table  4 1 1 

9. 13%  v 

70.601  Y 

61.67%' 

7.33%  v 
7*.*ox y 
66.87%' 

YULE'S  Q AND  PERCENTAGES  OVER  25  CRISES 

%**  YULE' 

S Q FOR  TENSION  SSS 

CRISIS 

THRESHOLD 

RmU 

TENSION 

l^F 

1/2F 

1/FSS2 

I'F+i 

AUERAGI 

70 

0.482 

0.399 

0.490 

0.461 

9.344 

0.313 

False 

Alar* 

33.33% 

17.67% 

24.675; 

26.90% 

20.90% 

Hiss 

6.  335. 

9.O05; 

8.33% 

8 . 335; 

9.90% 

Hit 

Corrcc  t 
Rejcc  tton 

1 2 . i7\v 
60.  J4X} 

47.675;' 

10. 005. v 
n.m) 
63.33%' 

10  . 67%v 
*7.00X> 

36  . 335;'' 

Table  4-12 

10.67%v 

6J.67XS 

33.00%' 

10.99%V 

71.00X> 

61.99%' 

PERCENTAGES  OF  A 70  THRESHOLD  OVER  25  CRISES 
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CRISIS  RAW 


THRESHOLD 

TENSION 

1 'F 

1'2F 

l'FM2 

l'F*l 

AUERAGE 

99 

0.433 

0.334 

0.433 

0.389 

9.496 

9.394 

False 

Alar* 

24.67% 

6.33% 

10.33% 

12.33% 

7.33% 

Hiss 

9.005. 

14.67% 

13.67% 

11.33% 

14.67% 

Hit 

Corrcc  t 
Rejec  t ion 

10.dO\v 

66.1JX> 

36.33%' 

4.33%v 

7».00X  ) 

74.67%' 

3. 33%  v 

7».00X> 

70.67%' 

7.67%v 

7».J*X> 

68.67%' 

4. 33%v 

7».00X> 

73.67%' 
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The  analyst,  with  his  unique  expertise  and 
responsibility,  must  decide  what  mix  of  general  reliability 
and  percentage  of  hits,  misses,  and  false  alarms  is  best  ad- 
dressed to  his  task.  We  can  provide  data  on  which  he  can 
base  his  decision  and  help  evaluate  its  consequences.  EWAMS 
can  supplement  his  expertise  by  making  him  more  efficient 
and  organizing  his  information.  Only  he  can  decide  which 
thresholds  and  hit/false  alarm  rates  are  best  suited  to  his 
needs . 

Tension — Future  Research:  The  tension  indicator 
algorithm  in  the  master  version  of  EWAMS  has  been  changed  to 
the  algorithm  weighting  it  for  1/total  number  of  events. 

This  will  reduce  tension  scores  based  on  a small  number  of 
events  and  provide  the  analyst  with  an  indicator  which 
better  reflects  the  true  state  of  affairs.  It  will  also 
provide  the  analyst  with  a reference  warning  threshold  of 
70-75  as  a "best  guess."  Tension  thresholds  greater  than 
this  slightly  increase  his  chances  of  missing  and  decrease 
the  hit  rate. 

Research  is  now  being  done  on  generating  proba- 
bilities of  conflict  and  crisis  with  the  weighted  tension. 

Of  course,  this  could  be  done  by  simply  dividing  the  tension 
scores  by  100.  However,  surveying  the  scores  for  twenty-five 
crises  suggests  such  probabilities  could  be  too  high  and 
could  lead  to  a high  faise  alarm  rate.  Probabilities  based 
on  straight  transformation  of  tension  levels  over  70  would 
result  in  more  misses  and  false  alarms  than  might  be  the 
case  if  another  method  of  deriving  probabilities  from  tension 
were  developed.  The  first  such  attempt  will  generate  progres- 
sive z-scores  for  the  new  tension  algorithm  and  calculate 
probabilities  from  them  as  done  for  total,  conflictual,  and 
cooperative  activity  (Daly  and  Bell  1977b) . 
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The  tension  indicator  is  a prime  candidate  for 
the  blend  of  subjective  and  objective  IfcW  indicators.  Since 
EWAMS  has  just  begun  running  on  a "real-time"  basis  with 
daily  updates,  assessments  of  country-pair  tension  can  be 
elicited  (perhaps  via  the  ARPANET  every  morning)  from 
experts  in  State  or  DoD.  These  could  then  be  compared  with 
the  empirically  generated  tension  levels.  This  cross- 
checking could  validate  or  modify  the  two  methods  of  generating 
tension  indicators.  It  would  also  be  useful  as  one  more 
component  of  a more  comprehensive  integration  of  subjective 
and  objective  indicators  for  I&W.  Finally,  when  a suffi- 
ciently long  time  series  of  expert  tension  assessments  had 
been  accumulated,  it  might  be  possible  to  develop  dyad- 
specific  tension  algorithms  which  could  then  be  incorporated 
into  the  master  Early  Warning  and  Monitoring  System. 

This  method  of  examining  hit/false  alarm  rates 
involves  the  use  of  decision-analytic  likelihood  ratios  and 
receiver  operating  characteristic  (ROC)  curves  (Green  and 
Swets  1966) . The  method  is  attractive  since  it  can  be 
applied  to  probabilities  generated  by  either  empirical  or 
personal  means.  A likelihood  ratio  is  a number  expressing 
the  ratio  of  the  probabilities  (which  could  be  generated  by 
an  expert  or  empirically)  of  an  event  (e.g.,  a crisis)  under- 
two  or  more  hypotheses  (for  example,  a z-score  for  conflic- 
tual  activity  of  6 versus  one  of  10).  Various  likelihood 
ratios  can  be  plotted  as  ROC  curves  as  the  probabilities 
used  to  calculate  the  ratios  are  altered.  For  our  purposes 
they  are  altered,  either  by  an  expert  or  empirically,  by 
changing  the  z-score  or  tension  thresholds  for  signalling 
crisis.  For  example,  a high  threshold  will  have  a high 
likelihood-ratio  criterion  and  low  probability  of  both  hits 
and  false  alarms.  As  the  likelihood  ratio  criterion  de- 
creases, hit  and  false  alarm  rates  will  increase  and  the 
slope  of  the  ROC  curve  will  decrease. 
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ROC  curves  will  permit  analysts  to  determine 
acceptable  hit/false  alarm  rates  and  to  set  thresholds 
accordingly.  This  option  should  be  attractive  to  potential 
users  since  it  is  likely  that  acceptable  hit/false  alarm 
rates  vary  with  analyst  and  command  level. 

EWAMS  will  eventually  utilize  a great  number  of 
indicators.  In  order  to  evaluate  the  utility  of  these  indi- 
cators it  will  be  necessary  to  calculate  Q values,  cell 
percentages,  and  success  rates,  for  each  indicator  separately, 
for  all  the  indicators  combined,  and  for  different  combina- 
tions of  the  indicators.  We  can  then  determine  the  useful- 
ness of  including  certain  indicators  or  certain  combinations 
of  indicators  in  the  system.  It  may  be  that  some  indicators 
are  not  useful  since  they  "cry  wolf"  too  often  even  though 
they  often  "hit." 

The  necessity  of  selecting  cases  for  the  tests 
and  for  the  generation  of  probabilities  is  a very  important 
consideration.  One  could  set  the  indicator  thresholds  at 
the  same  level  for  all  countries,  then  calculate  Yule's  Q, 
hit  and  correct  rejection  percentages,  probabilities,  and 
likelihood  ratios.  This  assumes  that  all  countries  act 
generally  the  same  before  and  during  crises.  The  other 
extreme  is  setting  thresholds  for  each  country  individually 
and  calculating  Q values,  percentages,  probabilities,  and 
likelihood  ratios  for  each  individual  country.  This  would 
assume  that  all  countries  are  unique  and  that  accurate 
forecasting  requires  that  the  analyst  consider  each  country 
separately.  Both  extremes  present  problems.  Using  all 
countries  together  may  obscure  differences  between  countries 
and  thus  distort  forecasting  results.  For  example,  it  may 
be  that  a political  stability  indicator  threshold  should  be 
set  much  higher  for  a South  American  country  (where  stability 
is  usually  low  and  fluctuates  widely)  than  for  some  Western 
European  countries  (where  stability  is  generally  high) . 
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Setting  the  thresholds  at  the  same  level  for  all  countries 
may  thus  hinder  good  forecasting.  On  the  other  hand,  if  one 
chooses  to  set  threshold  levels  for  each  individual  country, 
one  runs  into  data  problems.  Very  few  countries  have  been 
involved  in  enough  crises  to  generate  sufficient  data  to 
warrant  making  forecasts  about  their  future  crisis  behavior. 
With  the  exception  of  certain  Middle  East  countries,  no 
country  has  more  than  a few  crisis  months  from  which  to 
generalize.  Attempting  to  calculate  Q values,  percentages, 
probabilities,  and  likelihood  ratios  for  such  countries 
would  prove  unfruitful  and  would  most  likely  cause  distor- 
tion. 

Regional  Tension--A  Middle  East  Case  Study: 
Despite  the  encouraging  results  of  testing  the  tension 
indicator  across  twenty-five  global  crises,  it  was  felt  that 
the  conflict  and  tension  which  has  historically  characterized 
the  Middle  East  suggested  a strong  possibility  that  a 
region-specific  algorithm  and  threshold  would  differ  from  a 
global  one. 

Additional  reasons  for  focusing  on  a regional 
subsystem  as  opposed  to  the  international  system  as  a whole 
or  the  actions  of  one  or  two  nations  are  given  by  Thompson 
(1973) : 


A regional  focus  reduces  the  complexity  associated 
with  the  international  system. 

A regional  focus  uses  boundaries  which  are  based 
on  common  usage  and  empirical  reality. 

A regional  focus  encourages  the  integration  of 
area  specialists  and  international  relations 
students . 

A regional  focus  provides  the  basis  for  compara- 
tive analysis. 
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To  these  we  can  add  a fifth  reason: 

• Regions  may  have  unique  interaction  patterns  not 

observable  by  either  a systemic  or  dyadic  analysis. 

To  the  extent  this  is  so,  we  can  improve  our  indi- 
cators for  early  warning  and  monitoring. 

Thus,  by  focusing  on  a regional  subsystem,  we 
can  simplify  an  analytical  focus  and  at  the  same  time  per- 
haps discover  something  unique  and  important  about  a part  of 
the  international  system. 

Why  the  Middle  East?  The  five  general  rationales 
for  focusing  on  regional  subsystems  yield  several  specific 
rationales  for  examining  the  Middle  East  and  its  crises  in 
terms  of  the  tension  indicator.  First,  in  terms  of  the 
complementarity  of  the  research  of  area  specialists  and 
international  relations  analysts,  the  October  War  demonstrated, 
with  an  oil  embargo  and  superpower  confrontation,  that 
subordinate  system  politics  can  intrude  on  broader  inter- 
national system  politics  as  well  as  vice  versa.  Thus, 

29 

"second  order  crises"  ' may  have  more  dangerous  results  than 
the  regional  crises  that  trigger  them. 

Second,  in  terms  of  the  benefits  of  comparative 
analyses,  a study  of  the  Middle  East  system  and  its  crises 
can  serve  as  the  basis  for  comparison  and  evaluation  of  a 
system  for  monitoring  international  or  subordinate  system 
relations  and  forecasting  crises.  If  comparison  reveals 
that  an  indications  and  warning  system  performs  better  in 
one  region  than  in  another,  the  system  can  be  modified  or 
made  more  flexible.  Modifications  and  improvements  based  on 
such  comparisons  are  not  only  aesthetically  and  intellec- 
tually pleasing,  they  are  helpful  to  users  who  may  be  tasked 
with  providing  warning  of  second  order  crises. 

rs 

For  a look  at  Middle  East  crises  from  a system  per- 
soective,  see  McClelland  (1977  and  1976). 

29 

This  notion  is  ablv  illustrated  bv  Belden  (1977). 
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Third,  in  contrast  to  the  above  report  on  the 
performance  of  the  tension  indicator  over  twentv-five  "qlobal" 
crises  occurrinq  between  1966-75  and  the  development  of  a 
tension  alqorithm  to  be  used  when  the  analyst's  focus  is  a 
qeneral  one,  the  research  was  addressed  to  developing  a 
tension  algorithm  which  would  monitor  Middle  East  interaction 
and  warn  of  crises  in  the  region  better  than  would  the 
general  algorithm.  By  improving  the  warning  and  monitoring 
performance  of  the  indicator,  a region-specific  tension 
algorithm  could  be  very  useful  to  those  in  the  I&W  community 
focusinq  on  the  Middle  East. 


The  tension  and  Yule's  Q proqrams  used  in  this 
research  are  fully  described  above.  For  the  Mideast  research, 
unweighted  and  weighted  tensions  were  calculated  over  various 
combinations  of  fourteen  Middle  Eastern  crises.  The 
country  pairs  and  crisis  years  are  presented  in  Table  4-14. 

The  USA  was  the  only  non-regional  actor  included  in  the 
analysis.  The  four  combinations  of  Middle  East  crises 
examined  were:  all  fourteen,  all  except  USA-SYR,  all  Arab- 
Israeli,  and  the  1967  and  1973  wars. 
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MIDDLE  EAST  CRISIS  CASES 


3%el ineation  of  crisis  actors  and  periods  is  based  on 
Moore  (1975)  and  Butterworth  (1976). 
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The  results'^  suaaest  a Mideast-soecif ic  tension 
alaorithm  for  imoroved  monitorina  of  Middle  East  political 
interactions  and  for  more  reliable  and  accurate  warning  of 
regional  crises.  The  results  also  suggest  a warning  threshold 
for  that  algorithm.  Finally,  for  Middle  East  analysts  more 
concerned  with  hit  and  false  alarm  rates  than  with  general 
indicator-reality  associations,  the  research  yields  a variety 
of  options  from  which  he  can  choose.  The  key  findings  are 
that : 


2 

Tension  weighted  by  1/f  is  the  most  general 
reliable  tension  algorithm  for  the  Middle  East. 
For  that  weight,  the  tension  algorithm  would  be: 


TENSION  * 


I CON  _ CON  \ 
( TOT  TOT3] 


x 100 


• For  that  weight,  75  is  the  most  useful  warning 
threshold . 

• There  are  a variety  of  options  available  to  the 
analyst  concerned  with  hit  and  false  alarm  rates. 


While  we  cannot  claim  to  have  discovered  an 
interaction  pattern  unique  to  the  Middle  East,  the  preceding 
has  indicated  that  the  region  is  best  monitored  with  a 
tension  indicator  different  from  the  global  measure.  It  is 
not  surprising,  given  Middle  East  history,  that  the  reference 
threshold  for  the  region  is  higher  than  the  global  one.  The 
tension  measure  with  the  strongest  indicator-reality  asso- 
ciation for  twenty-five  non-region-specific  crises  is  1/f 
with  a reference  threshold  of  70.  (Daly  and  Bell  1977a) 

The  strongest  overall  association  for  the  Middle  East  is 

2 

provided  by  a 1/f  weight  with  a reference  threshold  of  75. 
The  analyst  concerned  with  general  associations  would  there- 
fore use  different  algorithms  and  reference  thresholds  for 
global  and  Middle  East  tracking. 
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For  details  of  results  and  analyses  see  Daly 


(1977a) . 
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The  next  step  is  to  do  cross-regional  compari- 
sons. Given  constraints  of  data  and  current  history,  the 
most  likely  candidate  is  Africa.  Research  should  be  done  to 
determine  if,  and  if  so,  why  and  how,  an  African  tension 
algorithm  will  differ  from  a global  and  Mideastern  measure. 

Hopefully,  payoffs  from  such  research  will  include  not  only 
improved  performance  of  the  tension  indicators (s)  per  se, 
but  also  generation  of  reliable  probabilities  of  conflict 
and  crisis  from  the  tension  measure  (Daly  and  Bell  1977a) . 

Finally,  while  this  research  has  suggested,  in 
terms  of  indicator-reality  signals,  a Mideast-specific 
tension  algorithm,  it  also  indicates  that  the  expertise  and 
responsibility  of  the  analyst  must  be  the  final  arbiter, 
based  on  tolerable  hit/false  alarm  rates,  of  the  weight/ 
threshold  combination  to  be  used  in  monitoring.  Whatever 
the  analyst's  choice,  the  Mideast-specific  tension  algorithm 
and  several  hit/false  alarm  rate  options  should  facilitate 
and  improve  his  monitoring  and  warning  for  the  region. 

Weighting  Tension--An  Examination  of  Cell  Fre- 
32 

quencies ; Discussion  of  our  research  on  tension  with 
potential  users  revealed  that  we  needed  to  do  more  work  on 
thresholds  and  hit  rates.  This  section  reports  the  results 
of  that  effort. 

When  an  I&W  analyst  uses  the  Early  Warning  and 
Monitoring  System  to  assist  his  judgment  on  the  likelihood 
of  conflict,  there  are  four  potential  outcomes.  He  may  hit, 
miss,  false  alarm,  or  correctly  reject  the  possibility  of  a 
crisis.  A series  of  tests  were  called  for  on  the  tension 
algorithm  weighted  by  1/f  and  the  effect  of  the  weighting  on 

32 

This  section  borrows  heavily  from  Davies  (1977). 

^3For  a description  of  these  outcomes  see  Dalv  and 
Bell  (1977a). 
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the  probability  of  the  four  possible  outcomes.  A detailed 
comparison  was  made  between  the  raw  tension  measure  and  the 
1/f  tension  measure  for  various  thresholds.  The  Israeli- 
C Syria  crisis  of  June  1967  was  used  to  illustrate  some  key 

points,  while  twenty-five  historical  crisis  cases  occurring 
between  1966-1975  served  as  the  basis  for  several  generali- 
zations. Key  findings  and  implications  of  this  research 
include: 


c 


( 

i 
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• Weighting  the  raw  tension  measure  by  1/f  and 
increasing  the  tension  threshold  have  similar 
effects  on  the  type  of  warning.  Both  result  in 
fewer  predictions  of  crisis. 

• Row  percentages  allow  the  analyst  to  reassess  the 
performance  of  the  different  tension  measures 
depending  on  his  preferences  for  each  type  of 
outcome . 

• Of  those  monthly  observations  which  are  reclassi- 
fied as  a consequence  of  weighting  the  tension 
measure  by  1/f,  an  average  of  79%  are  reclassified 
correctly. 

• The  consequence  of  using  a 1/f  weight  is  the  same 
across  almost  all  tension  threshold  values.  Once 
differences  in  the  number  of  crisis  and  no  crisis 
predictions  are  taken  into  account,  the  effect  of 
1/f  is  to  increase  the  percentage  of  hits  and 
misses,  and  decrease  the  percentage  of  false 
alarms  and  correct  rejections. 


Weighting  the  raw  tension  value  by  1/f  (as  is  now  done  in 

EWAMS)  decreases  the  value  of  tension  for  all  observations. 

fl  This  can  be  seen  in  Table  4-15  which  presents  the  monthly 

unweighted  and  1/f  weighted  tension  values  for  the  two-way 

flow  of  events  between  Israel  and  Syria  during  the  period 

January  1967  to  December  1967.  The  size  of  the  reduction  in 

f!  each  month  is  dependent,  in  part,  on  the  total  number  of 

34 

events  in  that  month.  For  the  same  raw  tension  value,  the 
smaller  the  number  of  total  events  the  greater  the  size  of 
the  decrease. 



( 1 T3 

The  absolute  size  of  the  decrease  is  a function  of 
both  the  number  of  events  and  magnitude  of  the  original 
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Month 


Total 

No.  Events 


Unweighted 

Tension 


1/f  Tension 


January 

27 

77.78 

74.89 

February 

5 

100.00 

80.00 

March 

0 

50.00 

0 

April 

10 

100.00 

90.00 

May 

2 

100.00 

50.00 

June 

26 

80.76 

77.66 

July 

8 

75.00 

65.62 

August 

0 

50.00 

0 

September 

1 

100.00 

0 

October 

1 

100.00 

0 

November 

3 

100.00 

66.60 

December 

0 

50.00 

0 

Table  4 15 

ISRAEL-SYRIA,  1967 
75  THRESHOLD 


Of  primary  interest  is  the  effect  of  such  a 
weighting  scheme  on  the  warning  and  monitoring  capabilities 
of  the  tension  measure.  In  previous  testing  of  the  effects 
of  several  possible  weighting  formulas  on  monitoring  and 
warning  capabilities,  two  measures  of  performance  were 
examined--Yule ' s Q and  the  overall  percentage  of  successes 
(Daly  and  Bell  1977a).  Across  both  of  these  criteria, 

Yule's  Q and  the  percentage  of  outcomes  which  were  hits  and 
correct  rejections,  the  1/f  weight  consistently  outperformed 
the  raw  tension  measure  in  providing  warning  of  impending 
crises.  However,  with  both  Yule's  Q and  hit/false  alarm 
rates  based  on  the  total  number  of  observations,  problems  do 
arise  for  ongoing  warning  situations. 


Yule's  Q is  problematic  for  several  reasons,  but 

especially  troublesome  is  the  fact  that  it  can  take  on  a 

value  of  +1  when  there  is  not  a perfect  correspondence 

35 

between  indicator  warning  and  reality.  That  this  is  the 
case  can  be  seen  in  Tables  4-16  and  4-17  which  depict  the 
correspondence,  at  a threshold  of  75,  between  indicator 
warning  and  reality  for  Israel  and  Syria.  Although  the 
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Table  4-16 


Table  4 17 


ISRAELSYRIA,  1967 
UNWEIGHTED  TENSION 
75  TENSION  THRESHOLD 


ISRAELSYRIA,  1967 
1/f  WEIGHTED  TENSION 
75  TENSION  THRESHOLD 


tension  value.  When  expressed  as  a percentage  of  the  original 
tension  value,  the  decrease  is  strictly  a function  of  the 
total  number  of  events. 

"^This  possibility  is  also  discussed  by  Daly  & Bell  (1977a). 
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Yule's  Q for  Table  4-16  takes  on  a value  of  +1.0,  there  is 
not  a perfect  association  between  the  indicator  warnings  and 
reality.  The  effect  of  the  seven  false  alarm  predictions  is 
negated  by  the  zero  number  of  misses.  Additionally,  although 
the  Yule's  Q for  Table  4-16  indicates  a greater  similarity 
between  indicator  warning  and  reality  than  that  which  exists 
in  Table  4-17,  this  is  not  reflected  in  the  overall  number 
of  successes  for  the  two  tables.  For  this  particular  crisis, 
the  Yule's  Q criterion  might  lead  an  analyst  to  the  conclusion 
that  the  raw  tension  measure  is  a better  warning  measure. 

On  the  basis  of  the  overall  number  of  successes,  however, 
the  1/f  weight  appears  to  be  the  algorithm  which  provides 
the  best  warning. 

In  addition  to  problems  with  using  Yule's  Q as  a 
measure  of  performance  of  a tension  algorithm,  caution  must 
also  be  used  in  employing  percentages  which  are  based  on  the 
total  number  of  observations.  Total  percentages  are  in- 
fluenced by  two  different  factors.  First,  they  are  sen- 
sitive to  the  probability  that  a certain  type  of  warning 
will  be  made  by  the  indicator  signals.  Second,  total  per- 
centages are  affected  by  the  probability  that  a type  of 
event  will  follow  the  warning  given.  A total  hit  percent- 
age, for  example,  is  a summary  measure  of  the  probability 
that  a crisis  warning  will  be  given  and  the  probability  that 
a crisis  follows  this  warning. 

Because  total  percentages  are  equally  sensitive 
to  both  these  factors,  it  is  possible  to  have  a situation  in 
which  one  tension  measure  does  much  better  than  a second  one 
in  predicting  crises,  yet  this  is  not  reflected  in  the  total 
percentages.  As  an  example  of  this  possibility,  consider 
the  following.  Suppose  monthly  forecasts  were  made  over  two 
one-year  periods.  Over  the  first  twelve  months,  there  were 
six  hits  or  50%  of  the  total  number  of  predictions  were 
hits.  In  the  second  year,  twelve  monthly  predictions  were 
again  made  but  only  four  hits  occurred  for  a total  hit 
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percentage  of  33%.  On  the  basis  of  these  two  yearly  hit 
percentages,  the  performance  of  the  warning  system  appears 
to  have  been  much  better  in  the  first  year  than  in  the 
second.  What  is  not  controlled  for,  however,  is  the  number 
of  times  a crisis  prediction  was  made  or  the  probability  of 
a crisis  warning  in  each  of  the  two  years.  In  year  one,  a 
crisis  could  have  been  predicted  for  eleven  months,  whereas 
in  the  second  year,  a crisis  could  have  been  predicted  only 
four  times.  Consequently,  hits  would  be  much  more  likely  in 
year  one  because  a crisis  prediction  was  made  almost  three 
times  as  often  as  it  was  in  the  second  year. 

To  adjust  the  total  hit  percentages  so  that 
differences  in  the  number  of  crisis  predictions  in  each  year 
are  not  influencing  the  performance  of  the  warning  system, 
it  is  necessary  to  divide  the  total  hit  percentage  by  the 
percentage  of  times  a crisis  prediction  is  made.  This 
procedure  is  equivalent  to  dividing  the  number  of  times  a 
hit  is  made  by  the  number  of  times  a crisis  is  predicted, 
resulting  in  row  percentages  (see  Tables  4-18  and  4-19) . 

Once  the  total  percentages  have  been  adjusted,  this  produces 
a year  one  hit  percentage  of  55%  and  a year  two  hit  percen- 
tage of  100%.  In  year  one,  of  the  number  of  times  a crisis 
is  predicted,  55%  result  in  hits.  Of  the  four  times  a 
crisis  is  predicted  in  year  two,  100%  result  in  hits.  When 
the  unequal  number  of  crisis  predictions  is  controlled  for, 
the  hit  performance  of  the  warning  system  in  the  second  year 
is  better  than  its  performance  in  the  first. 

If  the  row  totals--that  is  the  number  of  crisis 
and  no  crisis  predictions  in  Figure  4-19--are  different, 
this  indicates  that  certain  outcomes  have  a higher  probability 
of  occurring.  To  take  into  consideration  this  inequality 
and  its  influence  on  the  number  of  hit,  false  alarm,  miss, 
and  correct  rejection  outcomes,  each  cell  frequency  must  be 
divided  by  the  row  totals  to  give  row  percentages.  The  row 
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percentages  provide  an  assessment  of  the  probability  of  an 
outcome  given  an  indicator  signal  of  either  crisis  or  no 
crisis. 


The  1967  Israel-Syria  Case:  The  importance  of 
controlling  for  differences  in  the  number  of  crisis  and  no 
crisis  predictions  by  computing  row  percentages  can  be  seen 
in  the  Israeli-Syrian  crisis  of  1967.  By  using  the  observa- 
tions presented  earlier  in  Table  4-15,  each  month  between 
January  and  December  for  the  Israel-Syria  country-pair  was 
classified  according  to  whether  or  not  a crisis  occurred, 
what  type  of  warning  was  given  for  that  particular  month  and 
by  the  outcome  for  both  the  unweighted  raw  tension  measure 
and  the  1/f  weighted  one.  The  results  of  this  operation, 
using  a threshold  value  of  75,  are  given  in  Table  4-20. 
Overall,  the  effect  of  the  1/f  weighted  tension  is  to  change 
the  indicator  signals  for  six  months.  Each  reclassification 
involves  a shift  in  the  signals  from  crisis  to  no  crisis. 

Of  the  six  changed  months  83%  (January,  July,  September, 
October,  November)  are  reclassified  accurately  to  correct 
rejections.  One  month,  May,  is  reclassified  incorrectly 
from  a crisis  to  a miss. 

Tables  4-21a  through  4-21d  display  each  outcome 
frequency  in  the  Israel-Syria  case  as  percentages  for  both 
the  raw  and  weighted  tension. ^ Tables  4-21a  and  4-21b, 
which  percentagize  each  cell  frequency  on  the  basis  of  the 

total  number  of  predictions,  indicate  that  when  the  percen- 
tage of  overall  successes  is  considered  the  weighted  tension 
outperforms  the  unweighted  indicator  (75%  success  for  1/f 
and  42%  success  for  the  raw  tension) . 

^The  interactive  program  for  making  these  calculations 
on  a standalone  Tektronix  4051  was  written  by  Brenda  Bell 
and  Don  Harrison.  An  example  of  the  computer-analyst  exchange 
that  produced  these  tables  can  be  found  in  Davies  (1978b). 
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Unweighted 

Tension  1/f  Weighted  Tension 


Month 

Reality 

Indicator* 

Outcome** 

Indicator 

Outcome 

January 

No  Crisis 

C 

FA 

NC 

CR 

February 

No  Crisis 

C 

FA 

C 

FA 

March 

No  Crisis 

NC 

CR 

NC 

CR 

April 

No  Crisis 

C 

FA 

C 

FA 

May 

Crisis 

C 

Hit 

NC 

Miss 

June 

Crisis 

C 

Hit 

C 

Hit 

July 

No  Crisis 

c 

FA 

NC 

CR 

August 

No  Crisis 

NC 

CR 

NC 

CR 

September 

No  Crisis 

C 

FA 

NC 

CR 

October 

No  Crisis 

C 

FA 

NC 

CR 

November 

No  Crisis 

C 

FA 

NC 

CR 

December 

No  Crisis 

NC 

CR 

NC 

CR 

*C  - 
NC  - 

Crisis 

No  Crisis 

**FA  - 
CR  - 

False  Alarm 

Correct  Rejection 

Table  4-20 

ISRAEL  SYRIA.  1967 
75  TENSION  THRESHOLD 
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A comparison  of  Table  4-21a  with  4-21b  suggests 
that,  in  addition  to  increasing  the  overall  percentage  of 
successes,  1/f  apparently  acts  to  decrease  the  percentage  of 
hits  and  false  alarms  and  to  increase  the  percentage  of 
misses  and  correct  rejections.  However,  the  raw  tension 
measure  predicts  nine  crisis  months  and  three  no-crisis 
ones,  while  the  1/f  measure  oredicts  three  crisis  months  and 
nine  no  crisis  ones.  To  examine  the  effect  of  this  difference, 
new  cell  percentages,  based  on  the  row  totals,  were  computed. 
Tables  4-21c  and  4-21d  show  these  cell  percentages  for  both 
measures.  Although  the  overall  percentage  of  successes  for 
a given  table  does  not  change,  the  effect  of  the  1/f  weight 
on  the  pattern  within  the  table  is  quite  different  than  that 
indicated  in  Tables  4-21a  and  4-21b.  When  row  totals  are 
used,  the  percentage  of  hits  increases  by  11%  rather  than 
decreases.  Similarly,  the  percentage  of  correct  rejections 
does  not  increase  but  decreases  from  100%  to  89%.  Although 
the  direction  of  the  change  for  false  alarms  and  misses 
remains  the  same,  the  magnitude  of  the  change  differs.  The 
summary  findings  from  the  Israeli-Syria  case  are  that: 

• given  a prediction  of  crisis,  the  1/f  weighted 
tension  measure  is  much  more  likely  to  result  in  a 
hit  than  is  the  unweighted  measure;  and 

• given  a prediction  of  no  crisis,  the  1/f  measure 
is  less  likely  to  result  in  a correct  rejection. 

Comparison  Across  Twenty-five  Historical  Crises: 

Outcome  percentages  based  on  row  totals  rather  than  on  total 

n size  are  designed  to  measure  the  performance  of  tension 

weights  free  from  the  influence  of  different  numbers  of 

, 37 

crisis  and  no-crisis  warnings.  So  far  the  performance  of 


The  row  percentages  in  these  tables  are  equivalent  to 
regressing  the  reality  variable  on  the  indicator  signals 
where  crisis  = 1 and  no  crisis  = 0.  For  example,  the  dif- 
ference between  % hit  and  % miss  = b in  the  regression 
equation  y = a+bx.  More  generally: 
a = % miss 
a+b  » % hit 
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the  1/f  tension  measure  has  only  been  examined  in  one  his- 
torical case  and  for  one  threshold  level.  Of  primary  im- 
portance is  whether  or  not  the  1/f  tension  measure  has 
general  effects  not  only  across  several  tension  levels,  but 
also  across  a number  of  crises.  In  order  to  examine  this 
possibility,  an  analysis  similar  to  the  one  just  described 
for  the  Israeli-Syria  case  was  carried  out  for  twenty-five 

..vstorical  crises  and  for  thresholds  ranging  in  value  from 
3 8 

70  to  90.  The  tabular  results  of  this  analysis  are  given 
in  Tables  4-22  to  4-26. 

Several  general  effects  of  the  1/f  tension 
measure  should  be  noted.  First,  when  the  1/f  weight  is 
applied  to  the  raw  tension  scores,  an  average  of  sixty-three 
observations  are  moved  from  one  cell  to  another  for  each 
threshold.  The  exact  percentage  reclassified  correctly 
varies  slightly  across  different  threshold  levels.  For 
example,  when  a threshold  value  of  70  is  used,  the  1/f 
tension  measure  results  in  a movement  of  fifty-five  cases, 

86%  of  which  are  reclassified  correctly.  When  a threshold 
value  of  90  is  used,  1/f  results  in  a reclassification  of 
seventy-two  cases,  with  76%  put  into  the  correct  cells.  On 
the  average,  79%  of  all  monthly  observations  are  reclassified 
correctly.  Thus,  the  1/f  tension  measure  is  not  only  sub- 
stantially affecting  a large  percentage  of  the  total  number 

of  cases,  but  it  is  also  greatly  improving  the  overall 

3 9 

percentage  of  successful  predictions. 

Second,  the  effect  of  the  1/f  weighted  tension 
measure  on  the  row  percentages  in  each  cell  is  consistently 

1-a  = % corrent  rejection 
l-(a+b)  = % false  alarm 

Also,  the  regression  coefficients  can  be  interpreted  as 
probabilities  of  certain  outcomes  given  indicator  signals  of 
crisis  or  no  crisis.  Thanks  to  Paul  Rossa  for  pointing  out 
this  probability  interpretation. 

3 8 

For  a complete  listing  of  the  file  of  all  twenty-five 
crisis  cases,  see  Daly  and  Bell  (1977a). 

39 

This  confirms  the  findings  of  Daly  and  Bell  (1977a). 
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ISRAEL  SYRIA.  1967 
75  THRESHOLD 
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the  same  across  almost  all  crises  and  threshold  levels.  The 
1/f  tension  measure  always  substantially  increases  the 
probability  of  a successful  hit  given  a crisis  prediction 

and,  thus,  always  decreases  the  probability  of  a false 

40 

alarm.  The  1/f  tension  measure  also  has  an  effect  on 
misses  and  correct  rejections.  At  every  threshold  level 
except  70,  where  there  is  no  effect,  the  1/f  tension  mar- 
ginally increases  the  probability  of  misses  and  decreases 
the  probability  of  correct  rejections. 

Third,  overall  the  1/f  tension  measure  outper- 
forms the  unweighted  measure.  This  is  because  the  substan- 
tial increase  in  the  probability  of  a hit  that  occurs  when 
the  1/f  weight  is  used,  consistently  offsets  the  small 
decrease  in  the  probability  of  a correct  rejection. 

Investigations  into  the  effects  on  cell  fre- 
quencies of  weighting  the  tension  measure  by  1/f  have  fur- 
ther substantiated  the  reasons  for  incorporating  the  measure 
into  EWAMS.  In  comparison  to  the  raw  tension  measure,  the 
1/f  weighted  tension  algorithm  always  reduces  the  number  of 
crisis  predictions  and  increases  the  number  of  no-crisis 
predictions.  Furthermore,  differences  in  the  number  of 
crisis  and  no  crisis  predictions  directly  affect  the  proba- 
bility of  each  type  of  outcome.  When  these  differences  are 
accounted  for  the  1/f  weighted  tension  measure  still  provides 

the  better  fit  with  reality.  Whether  this  finding  continues 

2 

to  hold  for  other  tension  weights  such  as  1/f  and  l/2f  is 
now  being  tested. 

The  immediate  advantage  of  using  row  percentages 
as  a means  of  assessing  the  performance  of  an  indicator  is 

To 

Note  that  this  is  not  the  case  when  percentages  based 
on  the  total  are  examined  because  total  percentages  do  not 
control  for  the  decrease  in  the  likelihood  of  predicting  a 
crisis  that  resutls  from  the  use  of  a 1/f  weighted  tension 
measure . 


r 
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that  no  assumptions  are  made  about  user  preferences  for 
outcomes  of  certain  types.  This  is  in  contrast  to  measures 
of  indicator-reality  associations,  such  as  Yule's  Q,  which 
weiqht  each  of  the  four  outcomes  in  the  table  equally. 

Measures  of  association  like  Yule's  Q implicitly  assume  that 
in  choosing  an  indicator  for  warning,  an  error  due  to  a 
false  alarm  is  just  as  bad  as  an  error  that  results  from  a 
miss.  Or,  that  a hit  outcome  is  just  as  desirable  as  a 
correct  rejection.  However,  users  do  not  have  equal  preferences 
across  all  outcome  types.  By  calculating  row  percentages,  a 
measure  of  performance  is  obtained  that  does  not  constrain 
the  analyst  to  equal  preferences  for  hits,  misses,  false 
alarms,  and  correct  rejections.  Additionally,  row  percent- 
ages have  a direct  substantive  interpretation  and  can 
easily  be  transformed  into  probabilities. 

We  are  currently  exploring  ways  in  which  user 
preferences  for  various  outcomes  can  be  integrated  into  the 
process  of  selecting  both  tension  weights  and  thresholds. 

One  approach  under  consideration  is  the  use  of  a decision 
model  that  would  combine  probabilities  with  user  preferences 
for  hit,  miss,  false  alarm  and  correct  rejection  outcomes. 

This  would  allow  the  analyst  to  reassess  the  performance  of 
different  tension  measures  depending  on  his  preferences  for 
each  type  of  outcome. 

4.2.2  Warning  and  forecasting  capability.  As  sug- 
gested with  varying  degrees  of  explicitness  throughout  this 
report,  warning--not  merely  information  retrieval  or  moni- 
toring--is  the  ultimate  objective  of  the  EWAMS  project. 

Indicator  thresholds,  such  as  those  discussed  above  for  the 
tension  measure,  and  probabilities  are  the  key  to  warning  in 
the  current  version  of  EWAMS. 
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4 1 

Probabilities:  The  "global”  probabilities  now 

42 

generated  by  EWAMS  differ  from  those  initially  used  in  the 
following  ways: 


• They  are  based  on  twenty-seven  historical  crises 
rather  than  four. 

• The  probabilities  of  crisis  for  total,  conflictual 
and  cooperative  activity  are  independent  rather 
than  those  for  total  and  conflict  being  identical 
for  the  same  z-score  ranges. 

• The  interactive  program  which  generates  proba- 
bilities allows  the  analyst  flexibility  in  terms 
of  number  and  selection  of  crisis  cases,  ranges  of 
z-scores  to  be  examined,  and  assignment  of  proba- 
bilities. 


4 3 

In  its  current  state,  the  probability  program  will  add 
considerable  validity  and  flexibility  to  on-going  research 
and  testing.  The  objectives  of  the  probability  generation 
task  have  been  fulfilled  in  at  least  a preliminary  fashion: 
the  demonstration  system  now  yields  more  valid  and  reliable 
tables,  research  and  testing  have  been  facilitated,  and  the 
groundwork  has  been  laid  for  a sophisticated  option  which 
will  enhance  user  input  and  expertise. 


"Global"  P-tables  are,  of  course,  no  such  thing. 

They  are  based  on  international  crises  between  1966-75  for 

which  we  had  adequate  data;  that  is,  African  and  Latin  American 

crises  are  excluded.  Inclusion  of  crises  from  these  regions 

would  have  been  detrimental  to  hit  and  false  alarm  rate 

calculations.  The  twenty-seven  crises  on  which  the  P-tables 

are  based  are  listed  in  Table  4-27. 



This  section  borrows  liberally  from  Daly  and  Bell 
(1977b) . 

4 2 

For  examples  of  "old"  probabilities  see  Andriole 
(1976a)  and  International  Public  Policy  Research  Corporation 
(1978)  . 

4 3 

In  this  context,  "standalone"  means  that  the  program 
is  separate  from  the  master  crisis  software;  it  does  not 
mean  that  the  program  is  independent  of  a host  computer. 
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Format : 

1.  Initiator 

2.  Recipient 

3.  Beginning  yr.  of  crisis  - Date 
A.  End  of  crisis  year  - Date 

5.  Pre-crisis  month  - Date 

6.  Beginning  month  of  crisis  - Date 

7.  Last  month  of  crisis  - Date 


Table  4 27 

FILE  OF  ALL  CRISIS  CASES 
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The  old  probabilities  were  based  on  visual  and 
manual  analysis  of  the  Czech,  India-Pakistan , and  Sino- 
Soviet  (1967  and  1969)  crises.  The  probabilities  resulting 
from  this  analysis  and  their  concommitant  z-scores  are  given 
in  Table  4-28.  Table  4-29  presents  the  z-scores  and  proba- 
bilities generated  from  the  sample  of  twenty-seven  crises. 

A comparison  of  the  total  activity  probabilities  indicates 
that  the  highest  probability  of  crisis  for  total  activity 
can  be  signalled  with  a lower  z-score  when  one  bases  the 
calculations  on  a greater  number  of  crises.  This  should 

provide  somewhat  greater  warning  time  and  raise  the  hit  rate 

44 

of  the  probabilities. 

With  the  old  probabilities,  those  for  total  and 
conflict  activity  were  identical  for  the  same  z-score  ranges. 

For  the  new  ones,  the  conflict  probabilities  were  generated 
independently.  It  is  to  be  noted  that  the  conflict  proba- 
bilities decrease  more  slowly  than  the  total  activity  proba- 
bilities. While  aware  of  McClelland's  view  that  total 
activity  is  most  important,  we  feel  that  in  light  of  the 
needs  of  prospective  users  of  the  system,  conflict  activity 
should  be  given  slightly  greater  weight  vis-a-vis  the  other 
two  indicators. 

Based  on  the  historical,  empirical  reality  of 
twenty-seven  crises,  probabilities  of  crisis  based  on  cooperative 
activity  can  only  provide  warning  in  the  upper  registers. 

This  does,  however,  coincide  with  the  logic  behind  McClelland's 
use  of  Hrel  (McClelland  et  al.  1971  and  McClelland  1972). 

A better  feel  may  perhaps  be  obtained  for  the 
differences  in  the  old  and  new  probabilities  by  looking  at 
some  case  studies  using  exactly  the  same  events  data  and 

44 

These  propositions  require  extensive  testing  in  both 
retrospective  and  "real-time"  modes. 
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indicators.  Tables  4-30  and  4-31  present  the  indicators  for 
the  old  and  global  probabilities  for  the  Czech  invasion. 

The  old  total  activity  indicators  seem  to  provide  more 
warning  than  the  new  total  activity  ones.  However,  an 
examination  reveals  that:  1)  the  old  total  probabilities  of 
.50  and  .70  for  February  and  March  1968  are  based  only  on 
cooperative  events — there  were  no  conflictual  ones;  and  2) 
the  global  conflict  probabilities  provide  slightly  better 
warning  of  the  crisis  and  are  definitely  better  at  recording 
the  aftershock  of  the  invasion. 

t As  indicated  by  Tables  4-32  and  4-33,  the  major 

difference  between  the  old  and  global  probabilities  for  the 
India-Pakistani  crisis  is  the  higher  old  probability  of  .70 
(versus  the  global  one  of  .56)  in  November,  the  first  month 
of  the  war.  However,  the  global  conflict  probabilities, 
which  we  are  emphasizing,  perform  much  better  than  the  old 
ones  in  that  they  do  not  drop  off  as  precipitously  after  the 
initial  peak  in  April  as  do  the  old  ones.  The  decline  to 
.01  for  three  consecutive  months  in  the  old  probabilities 
might  have  led  an  analyst  to  believe  that  the  trouble  had 
passed  and  a crisis  been  averted.  The  global  probabilities, 
being  higher  and  more  dynamic,  would  have  been  less  likely 
to  result  in  such  an  analysis. 

Both  the  old  and  new  probabilities  provided 
excellent  warning  of  the  June  1967  Middle  East  War  (Tables 
4-34  and  4-35)  . However,  both  sets  failed  rather  dismally 
in  forecasting  the  October  war  (Tables  4-36  and  4-37).  The 
global  probabilities  were  much  better  at  registering  the 
aftershocks  of  the  conflict.  The  inadequate  performance  of 
the  indicators  in  providing  warning  of  the  October  War 
suggests  the  need  for  generating  regional  probability  tables. 
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0.41 

29 

5.80 

0.  63 

Sep 

68 

41 

3.33 

0.40 

29 

5.51 

0.41 

13 

1 . 66 

0.23 

Oct 

68 

21 

1.24 

0.  16 

16 

2.03 

0.21 

5 

0.  39 

0.  18 

Nov 

68 

11 

0.41 

0.13 

4 

0.  10 

0.  15 

•4 

1 

0.67 

0.  10 

Dec 

60 

18 

0.32 

8.13 

8 

0.71 

0.  IS 

2 

-8.  10 

0.  10 

Table  4 31 

SOVIET  UNION  CZECHOSLOVAKIA 
TWO  WAY  MONTHLY  ACTIVITY  LEVELS 
JANUARY  - DECEMBER,  1968 
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NONTHL'i  ACTIVITY 
FEB,  1971  - JAN,  1972 


«**  1NP 

\<<\<< 

TMO-MAY 

FLOW  >>>> 

*>  PmK  Ml 

TOIAL 

ACT  1U1TY 

COOPERATIVE  ACTIVITY  COHF l 1 C TUAL  ACTIVITY 

DATE 

NUNBER 

2 -SCORE 

PROB 

NUNBER 

2-SCORE  PROB  NUNBER 

2-SCORE 

PB08 

FEB 

71 

t 

1.53 

. 18 

8 

-.  37 

1 6 

3.52 

.58 

NAB 

71 

4 

.79 

.85 

8 

-.37 

1 4 

1.94 

. 18 

APB 

71 

48 

16.  19 

.88 

3 

.98 

1 45 

26.67 

.98 

NAY 

71 

19 

2.57 

.48 

2 

.47 

1 17 

2.68 

.48 

JUN 

71 

0 

-.41 

.81 

8 

-.39 

1 8 

-.38 

.81 

JUL 

71 

3 

.85 

.81 

8 

-.38 

1 3 

.28 

.81 

AUC 

71 

2 

-.1 1 

.81 

8 

-.38 

1 2 

.83 

.81 

SEP 

71 

7 

.66 

.85 

2 

.49 

1 5 

.54 

.85 

OCT 

71 

22 

2.94 

.48 

1 

.85 

1 21 

3.27 

.48 

NOV 

71 

<0 

8.28 

. 78 

5 

1.81 

1 55 

8.46 

.78 

DEC 

71 

218 

22.28 

.98 

28 

8.25 

8 198 

22.  12 

.98 

JAN 

72 

18 

. 12 

.81 

7 

1.88 

1 3 

-.11 

.81 

Table  4 32 

INDIA  -*-*►  PAKISTAN 
TWO  WAY  MONTHLY  ACTIVITY  LEVELS 
FEBRUARY,  1971  - JANUARY,  1972 


Monthly  Ac  ttvi  ty 
Feb,  1971  - Jan.  19.2 

**«  i nd  <<<<<<■  Two-Maw  Flow  >>>>>>  pak  »** 


Total  Activity  Cooperative  Activity  Contlictual  Activity 

Date  nunber  z-score  prob  minber  z-score  prob  nuNber  z-acore  prob 


Feb 

71 

6 

1.53 

0. 16 

0 

-0.37 

0.  18 

6 

3.52 

0.46 

Nor 

71 

4 

8.79 

0. 13 

0 

-0.37 

0.  10 

4 

1.94 

0.23 

Apr 

71 

48 

16.  19 

0.95 

3 

8.90 

8. 15 

45 

26.67 

0.98 

Nay 

71 

19 

2.57 

0.40 

■> 

0.47 

0. 15 

17 

2.68 

0.40 

Jun 

71 

8 

-8.41 

0.10 

0 

-0.39 

0.  10 

0 

-0.38 

0. 10 

Jul 

71 

3 

0. 05 

0.13 

0 

-0.38 

0.  10 

3 

0.20 

0. 18 

Au* 

71 

2 

-8.11 

0.10 

0 

-0.38 

0. 18 

2 

0.03 

0.18 

Sep 

71 

7 

0.66 

0. 13 

2 

0.49 

0. 15 

5 

0.54 

0.18 

Oct 

71 

22 

2.94 

0.40 

1 

0.05 

0. 15 

21 

3.27 

0.48 

Nov 

71 

68 

8.28 

0.56 

5 

1.81 

0.21 

55 

8.46 

0.75 

Dec 

71 

218 

22.28 

0.95 

20 

8.25 

8.41 

198 

22. 12 

8.90 

Jan 

72 

18 

0.12 

0.13 

7 

1.80 

0.21 

3 

-0.11 

0.10 

Table  4 33 

INDIA  PAKISTAN 
TWO  WAY  MONTHLY  ACTIVITY  LEVELS 
FEBRUARY,  1971  - JANUARY,  1972 


113 


MONTHLY  ACTIVITY 
JAN.  1967  - dec.  1967 


«•*  ISR 

■'  < <\ 

tho-umy 

FLOW  >> 

> w > 

Syr  111 

TOTAL 

nCTIOITY 

COOPERmTIUE  activity 

conflictual  actiuity 

DATE 

NUMBER 

2-SCORE 

PROB 

number 

2-SCORE 

PROB 

NUMBER 

2-SCORE 

PROB 

JAN  67 

27 

4.44 

.30 

6 

6.02 

.20 

21 

3.93 

.38 

FEB  67 

3 

-.  14 

.01 

0 

-.38 

.01 

3 

-.81 

NAB  67 

B 

-.78 

.01 

0 

-.33 

.01 

0 

-.03 

.81 

ABB  67 

IB 

.SB 

.03 

0 

-.33 

.01 

10 

.87 

.83 

NAY  67 

2 

-.33 

.01 

0 

-.31 

.01 

2 

-.31 

.81 

JON  67 

26 

2.83 

.40 

3 

2.71 

.03 

21 

2.76 

.48 

JOL  67 

8 

. 14 

.01 

-» 

.33 

.01 

6 

.03 

.01 

AOC  67 

B 

-.83 

.01 

0 

-.39 

.01 

0 

-.87 

.01 

KB  67 

1 

-.67 

.01 

0 

-.37 

.01 

1 

-.68 

.81 

OCT  67 

1 

-.63 

.01 

0 

-.33 

.01 

1 

-.66 

.81 

NOV  67 

3 

-.38 

.01 

0 

-.34 

.01 

3 

-.33 

.81 

MC  67 

S 

-.76 

.81 

0 

-.52 

.01 

a 

-.88 

.81 

Table  4 34 

ISRAEL— ► SYRIA 

TWO-WAY  MONTHLY  ACTIVITY  LEVELS 
JANUARY,  1967  - DECEMBER,  1967 


Monthly  Ac  1 1 v i ty 
Jon,  1967  - Pec , 1967 

ttt  i*r  <<<\<<  Two -Hoy  Floy  >>>>n  viar  lit 


Total  Activity  Cooperative  Activity  Conflictual  Activity 

Date  nunber  z-icore  prob  nunber  z-acore  prob  nunber  z-score  prob 


Jan 

67 

8 

-8.87 

0. 10 

8 

-8.29 

8.10 

8 

-8.74 

0.18 

Feb 

67 

8 

-8.81 

8. 10 

8 

-8.28 

8. 10 

0 

-0.69 

8. 18 

Mar 

67 

8 

-8.76 

8. 10 

0 

-0.27 

8. 10 

0 

-0.66 

8. 18 

Apr 

67 

8 

-8.72 

0.10 

0 

-0.26 

0.10 

0 

-8.63 

8. 18 

Nay 

67 

13 

13.28 

8.80 

1 

1.73 

8.21 

12 

13.89 

8.88 

Jun 

67 

18 

3.36 

8.40 

4 

7.23 

8.41 

14 

4.46 

0.40 

Jul 

67 

39 

7.41 

0. 36 

3 

2.52 

0.21 

36 

8.27 

0.73 

Au« 

67 

5 

0.09 

0.13 

4 

2.96 

0.21 

1 

-8.30 

8. 10 

Sep 

67 

18 

1.46 

0.  16 

0 

-0.31 

0.  10 

18 

1.69 

8.23 

Oct 

67 

10 

0.33 

0.13 

0 

-0.49 

0.  10 

10 

0.63 

8. 18 

Nov 

67 

3 

-0.01 

0.10 

1 

0.27 

0.13 

4 

-8.83 

8.18 

Dec 

67 

2 

-0.33 

0. 10 

0 

-8.30 

0.  18 

2 

-8.28 

0.18 

Table  4 35 


ISRAEL— ► SYRIA 

TWO  WAY  MONTHLY  ACTIVITY  LEVELS 
JANUARY.  1967  - DECEMBER,  1967 


NON T ML V ACTIVITY 

jnn,  1973  - nc.  1973 


*»»  ISR  TWO-WAY  FLOW  >>'>■>>  UAR 

TOTAL  ACT 1»H  TY  COOPERATlUE  ACTIVITY  COHFLICTUhL  ACTIVITY 

DATE  NUMBER  '-SCORE  PROS  NUMBER  2 -SC ORE  PROS  NUMBER  2 -SC ORE  PROB 


JAN 

73 

B 

-.89 

.81 

8 

-.63 

.81 

8 

-.82 

.81 

PER 

73 

9 

-.29 

.81 

1 

-.85 

.81 

8 

-.29 

.81 

MAR 

73 

3 

-.68 

.81 

8 

-.63 

.81 

3 

-.62 

.81 

APR 

73 

B 

-.86 

.81 

8 

-.63 

.81 

8 

-.81 

.81 

NAY 

73 

4 

-.68 

.81 

I 

-.04 

.81 

3 

-.68 

.81 

JUN 

73 

8 

-.33 

.81 

» 

.55 

.01 

6 

-.48 

.81 

JUL 

73 

1 

-.88 

.81 

8 

-.63 

.81 

1 

-.73 

.81 

AUC 

73 

9 

-.26 

.81 

3 

1.14 

.81 

6 

-.39 

.81 

SEP 

73 

> 

-.72 

.81 

1 

-.85 

.81 

1 

-.72 

.81 

OCT 

73 

tea 

II.  35 

.88 

37 

21.23 

. 78 

147 

9.  18 

.78 

NOU 

73 

73 

2.54 

.48 

37 

8.73 

.48 

36 

1.13 

.85 

OCC 

73 

74 

2.49 

. 18 

19 

3.15 

.85 

55 

2.86 

.18 

Table  4 36 

ISRAEL  •*-*•  EGYPT 

TWO-WAY  MONTHLY  ACTIVITY  LEVELS 
JANUARY,  1973  - DECEMBER,  1973 


Monthly  hi t i vi ty 

Jan.  1973  - D«c , 1973 

Ul  i*r  c < < < C\  Two-Way  Flow  >>>>yy  uor  III 


Total  Activity  Cooperative  Activity  Conftictual  Activity 


data 

nunbar 

l-tcor«  prob 

nunbar 

z-acort 

prob 

nunbar 

X'tcorc  pre 

Jan  73 

8 

-8.89 

8. 18 

8 

-8.63 

8.  18 

8 

-8.82 

8. 18 

Fab  73 

9 

-8.29 

8. 18 

t 

-8.05 

8.  18 

8 

-8.29 

8. 18 

Mar  73 

3 

-8.68 

8. 18 

8 

-8.63 

8. 18 

3 

-8.62 

8.18 

Apr  73 

8 

-8.88 

8. 18 

8 

-0.63 

8.  18 

8 

-0.81 

8. 18 

May  73 

4 

-8.68 

8.  18 

1 

-8.84 

8.  18 

3 

-8.68 

8. 18 

Jvn  73 

8 

-8.33 

8. 18 

2 

1.33 

8. 15 

6 

-8.48 

8.18 

J«l  73 

t 

-0.98 

0.  18 

8 

-8.63 

8. 18 

1 

-8.73 

8. 18 

Aua  73 

9 

-8.26 

8.  18 

3 

1.14 

8.21 

6 

-8.39 

8.18 

Sap  73 

> 

-8.72 

8.  18 

1 

-0.85 

8.  18 

1 

-8.72 

8.  18 

Oct  73 

194 

11.55 

8.98 

37 

21.23 

8.95 

147 

9.  18 

8.75 

Nov  73 

73 

2.54 

8.44 

37 

8.73 

8.41 

36 

1.13 

8.23 

Oac  73 

74 

2.49 

8.48 

19 

3.15 

8.21 

55 

2.86 

8.48 

Table  4 37 

ISRAEL  ♦♦  EGYPT 

TWO  WAY  MONTHLY  ACTIVITY  LEVELS 
JANUARY,  1973  - DECEMBER,  1973 
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Development  of  Global  P-Tables:  Our  initial 


l 


E> 


t 


t 


L 


intention  to  generate  probabilities  for  crisis,  non-crisis, 
and  pre-crisis  periods  was  rendered  impossible  by  the  lack 
of  observations  in  the  pre-crisis  (the  month  proceeding  the 
crisis  month)  category.  The  pre-crisis  period  was  therefore 
merged  with  the  crisis  month  to  generate  the  probabilities. 
Although  this  is  a less  desirable  method  than  having  a 
separate  pre-crisis  category,  it  is  argued  that  when  one  is 
generating  probabilities  from  historical  data  to  be  even- 
tually used  on  "real-time"  data,  the  prediction  implied  by 
probabi 1 1 t les  should  be  based  on  as  much  information  as 
possible.  When  historical  pre-crisis  periods  do  not  contain 
enough  data  to  generate  probabilities,  pragmatism  requires  a 
hedging  of  both  historical  reality  and  theory.  The  merging 
of  pre-crisis  and  crisis  periods  has  obvious  implications 
for  hit  and  false  alarm  rates.  Logically,  the  method  should 
raise  false  alarm  rates;  given  our  data,  it  may  increase  hit 
rates.  In  either  case,  when  a real-world  crisis  does  occur, 

s 

the  warning  time  should  be  greater.  Based  on  our  conver- 
sations with  potential  users  of  the  system,  analysts  at 
their  level  are  quite  willing  to  trade  false  alarms  for 
increased  warning  time. 

After  it  was  decided  to  merge  the  crisis  and 

pre-crisis  categories,  frequencies  of  2-scores  (by  intervals 

of  one)  in  crisis  and  non-crisis  were  generated  as  were  row 

percents.  Tables  4-38  and  4-39  illustrate  this  process  for 

conflict  activity.  The  Tables  show  that  there  are  several 

intervals  with  no  i-scores  occurring  for  the  twenty-seven 

crises;  this  also  holds  for  total  and  cooperative  activity. 

The  z-scores  were  therefore  grouped  so  that  the  crisis 

percentages  would  decrease  with  the  2-scores.  The  final 

intervals  and  associated  probabilities  are  given  in  Tables 

4-40,  4-41,  and  4-42. 



The  propositions  will,  of  course,  be  thoroughly 
explored . 
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l. 


t. 


z-scorc  »rc<au«nci«* 


X - *C  Or  « 

cr  istf 

bob-ct  i» 

total 

♦ 28-  99 

6 

8 

6 

♦ 19-  28 

. 8 

8 

8 

♦ 18-  19 

8 

8 

8 

♦ 17-  18 

8 

8 

8 

♦ 16-  17 

8 

8 

8 

♦ 15-  16 

2 

8 

2 

♦ 14-  15 

8 

8 

8 

♦ 13-  14 

8 

8 

8 

♦ 12-  13 

1 

8 

1 

♦ 11-  12 

1 

2 

3 

♦ 18-  11 

8 

1 

1 

♦ 9-  18 

1 

8 

1 

♦ 9 

2 

1 

3 

♦ 7-8 

1 

8 

1 

♦ 6-7 

8 

1 

1 

♦ 5-6 

4 

3 

7 

♦ 4-5 

4 

2 

6 

♦ 3-4 

2 

4 

6 

♦ 2-3 

5 

8 

13 

♦ 1-2 

6 

24 

38 

♦ •-  1 

18 

52 

62 

♦-99-  8 

16 

165 

181 

Table  4 38 

CONFLICT  Z SCORES  FOR  27  CRISES 
BY  INTERVALS  OF  1 


t-tcori 

cr i*ii 

BoB-cr 1* 

total 

♦ 

28-  99 

1.88 

8.08 

1.00 

♦ 

19-  20 

8.00 

8.00 

0.00 

♦ 

18-  19 

8.88 

8.00 

0.00 

♦ 

17-  18 

8.08 

8.88 

0.08 

♦ 

16-  17 

0.88 

0.08 

0.80 

♦ 

15-  16 

1.08 

0.08 

1.88 

♦ 

14-  15 

8. 88 

8.00 

0.88 

♦ 

13-  14 

0.00 

8.88 

8.88 

♦ 

12-  13 

1.88 

0.88 

1.00 

♦ 

11-  12 

8.33 

8.67 

1.00 

♦ 

18-  11 

8.00 

1.88 

1.88 

♦ 

9-  18 

1.88 

0.88 

1.88 

♦ 

8-  9 

8.67 

0.33 

1.88 

♦ 

7-  8 

1.08 

0.88 

1.88 

♦ 

6-  7 

8.88 

1.88 

1.88 

♦ 

5-  6 

8.57 

8.43 

1.88 

♦ 

4-  5 

8.67 

8.33 

1.08 

♦ 

3-  4 

8.33 

8.67 

1.88 

♦ 

2-  3 

8.38 

8.62 

1.88 

♦ 

1-  2 

8.28 

8.88 

1.88 

♦ 

8-  1 

8.16 

8.84 

1.88 

♦-99-  8 

8.89 

8.91 

1.88 

Table  4 39 

CONFLICT  Z SCORES.  PERCENTS  FOR  27  CRISES 
BY  INTERVALS  OF  1 
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mmm 


total  activity  - two  way  flows 


z-score  frequencies 


2-score 

crisis 

noti-cris 

to  to  1 

♦ 16-  99 

5 

0 

5 

♦ 11-  16 

4 

2 

6 

♦ 6-11 

7 

7 

14 

♦ 2-6 

14 

23 

37 

♦ 1-2 

4 

26 

30 

♦ 0-  1 

8 

63 

71 

♦-99-  0 

19 

•'  142 

161 

probabi 1 i ties 


z 

-score 

crisis 

non-cris 

total 

♦ 

16-  99 

1.00 

0.00 

1.00 

♦ 

11-  16 

0.67 

0.33 

1.00 

♦ 

6-  11 

0.50 

0.50 

1.00 

♦ 

2-  6 

0.38 

0.62 

1.00 

♦ 

1-  2 

0.13 

0.87 

1.00 

♦ 

0-  1 

0.  11 

0.89 

1.00 

♦- 

99-  0 

0. 12 

0.88 

1.00 

corrected  probs  - total  activity 


z-score 

prob 

freq 

1/f 

l/2f 

l/f*2 

1/f+l 

♦ 

16-  99 

1.00 

5 

1.20 

1.10 

1.04 

.95 

♦ 

11-  16 

0.67 

4 

0.83 

0.75 

0.71 

0.80 

♦ 

6-  11 

0.50 

i 

0.57 

0.54 

0.51 

8.56 

♦ 

2-  6 

0.38 

14 

0.41 

0.39 

0.38 

0.40 

♦ 

1-  2 

0.  13 

4 

0.17 

0.  15 

0. 14 

0.  16 

♦ 

0-  1 

0.11 

8 

0.  13 

0.  12 

0.11 

0. 13 

♦ « 

-99-  0 

0.12 

19 

0.12 

0. 12 

0. 12 

. 10 

Table  440 


* Weight  used 


FINAL  INTERVALS,  TOTAL  ACTIVITY, 
PROBABILITIES,  AND  WEIGHTING  FACTORS 
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contlictuai  activity  - two  way  flows 


r-score  frequencies 


“SC  Or* 

cr isis 

Tion-cr  is 

total 

♦ 

1*  * 9? 

6 

0 

6 

♦ 

11-  16 

4 

2 

6 

♦ 

6-  11 

3 

2 

5 

4 

5-  ? 

5 

4 

9 

4 

2-  5 

11 

14 

25 

4 

1-  2 

6 

24 

36 

4 

0-  1 

18 

52 

62 

4- 

99-  0 

16 

165 

181 

prcbabi 1 i ties 

Z 

-score 

crisis 

non-cr  is 

total 

4 

16-  99 

1.6d 

6.06 

1.00 

4 

11-  16 

0.67 

0.33 

1.00 

4 

8-  11 

0.60 

8.40 

1.00 

4 

5-  8 

0.56 

0.44 

1.06 

4 

2-  5 

0.44 

0.56 

1.00 

4 

1-  2 

0.20 

0.80 

1.06 

4 

0-  1 

0.16 

0.04 

1.06 

4- 

99-  0 

0.09 

0.91 

1.06 

corrected  probs  - conflictual  activity 


z-scor e 

prob 

freq 

U* 

l/2f 

l/f*2 

l/-f+l 

4 

16-  99 

1.00 

6 

1.17 

1.08 

1.03 

.98 

4 

11-  16 

0.67 

4 

0.e3 

0.75 

0.71 

.80 

4 

8-  11 

0.68 

3 

0.80 

0.70 

0.67 

.75 

4 

5-  8 

0.56 

5 

0.67 

0.61 

0.58 

.65 

4 

2-  5 

0.44 

11 

0.48 

0.46 

0.44 

.48 

4 

1-  2 

0.20 

6 

0.23 

0.22 

0.21 

.23 

4 

0-  1 

0.16 

10 

0.  18 

0.17 

0.16 

.18 

♦-99-  0 

0.09 

16 

0.09 

0.09 

0.09 

. 10 

* Weight  used 

Table  4-41 

FINAL  INTERVALS,  CONFLICTUAL  ACTIVITY, 
PROBABILITIES,  AND  WEIGHTING  FACTORS 
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cooperative  activity  - two  way  flows 


z-score  frequencies 


z-score 

crisis 

non-cr is 

total 

♦ 16- 

00 

5 

0 

5 

♦ 4- 

16 

11 

18 

29 

♦ 1- 

4 

9 

39 

48 

♦ 0- 

1 

5 

33 

38 

♦-99- 

0 

31 

173 

204 

probabi 1 i tics 

z-scorc 

crisis 

non-cris 

total 

♦ 16- 

99 

1.00 

0.00 

1.00 

♦ 4- 

16 

0.36 

0.62 

1.00 

♦ 1- 

4 

0. 19 

0.81 

1.00 

♦ 0- 

1 

0.13 

0.87 

1.00 

♦-99- 

0 

0.15 

0.85 

1.00 

corrected  probs  - cooperative  activity 


z-score 

prob 

freq 

1/f 

l/2f 

l'f*2 

l'<  + \ * 

♦ 16-  99 

1.00 

5 

1.20 

1.10 

1.04 

.95 

♦ 4-  16 

0.38 

11 

6.41 

0.40 

0.38 

.41 

♦ 1-4 

0.  19 

9 

0.21 

0.20 

0.19 

.21 

♦ 0-  1 

0.  13 

5 

0.16 

0.14 

0. 14 

.15 

♦-99-  0 

0.15 

31 

0.16 

0.15 

0.  15 

. 10 

* Weight  used 


Table  4 42 

FINAL  INTERVALS,  COOPERATIVE  ACTIVITY, 
PROBABILITIES,  AND  WEIGHTING  FACTORS 


* 
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The  final  step  in  generating  global  P-tables  was 
to  experiment  with  different  weighting  factors.  The  rationale 
for  weighting  was  dual:  (1)  cosmetic — to  enhance  the  appear- 
ance of  the  probabilities  in  terms  of  dynamism  and  distance, 
and  therefore  increase  appeal  to  potential  users;  and  (2) 
theoretical — to  increase  the  impact  of  probabilities  based 
on  "extreme"  z-scores.  In  line  with  this,  all  the  weighting 
factors  tested  had  the  effect  of  increasing  probabilities, 
with  the  greatest  effect  being  on  high  z-scores  and  the  least 

effect  on  low  ones.  The  various  weighting  factors  and  their 

46 

results  appear  in  Tables  4-40,  4-41,  and  4-42. 

Selection  of  the  final  weight  for  each  indicator 

was,  again,  based  on  cosmetics  and  theory.  These  probabilities 

47 

are  hard-wired  into  the  master  version  of  EWAMS . 

A comparison  of  the  final  probabilities  f o~ 
total,  conflictual,  and  cooperative  activity  reveals  two 
arbitrary  decisions.  First,  the  empirically  founded  proba- 
bility  of  1.00  for  all  three  indicators  in  the  highest 
interval  was  reduced  to  .98  for  conflict  and  .95  for  total 
and  cooperative.  Despite  our  confidence  in  the  early  warning 
system  as  a whole,  given  inadequacies  in  data  which  some- 
times necessitated  a brute  force  methodology  for  probabilities, 
we  feel  that  forecasting  a crisis  with  a 1.00  probability 
would  be  somewhat  audacious.  Second,  all  probabilities  in 
the  -99  - 0 range  were  changed  to  .10. 

Future  Development:  Development  and  testing  of 
probability  tables  will  continue.  Our  intention  is  to 

y . ■ mm  - - 

bThe  general  algorithm  for  weighting  can  be  illustrated 
with  the  1/f  weight.  It  is  calculated: 

probability  + probability/frequency. 

47 

However,  with  the  interactive  standalone  version  of 
P-tables,  the  analyst  can  select  other  weights,  no  weights, 
create  his  own,  and  apply  them  to  any  crisis  of  his  choice. 
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enhance  flexibility,  increase  the  number  of  user  options, 
advance  testing  and  integrate  future  improvements  into  the 
master  version  of  EWAMS.  Possible  developments  along  these 
lines  might  include  giving  the  user  the  option  of  tails  of 
varying  lengths;  different  types  of  graphical  presentation 
of  probabilities,  such  as  log  odds  and  bar  charts;  and  menus 
oriented  toward  both  the  novice  and  expert. 

There  are  many  aspects  of  EWAMS  that  still 
require  exploration  and  testing.  Several  of  these  are 
related  to  P-tables.  Hit  and  false  alarm  rates  for  the 
indicators  per  se  and  for  probabilities  must  be  examined. 

This  will  require  interaction  with  potential  users  and 
designation  of  thresholds  addressed  to  their  needs. 

Different  tails  for  the  indicator  z-scores  must 
be  tested  before  integration  into  the  demonstration  system. 
That  is,  rather  than  calculating  z-scores  progressively 
since  1966,  the  results  of  using  only  30- , 60- , or  90-day 
tails  must  be  analyzed.  Related  to  this,  the  performance  of 
normal  z-scores  in  warning  of  crises  must  be  tested  and 
probabilities  generated  from  them  compared  with  those  based 
on  progressive  z-scores.  Probabilities  calculated  with 
Bayes'  Theorem  must  also  be  tested  and  compared. 

As  mentioned  above,  regional  P-tables,  at  least 

for  the  Middle  East,  must  be  generated  and  their  performance 

compared  with  the  "global"  tables.  Probability  conversion 

tables  for  nations  with  similar  structural  characteristics, 

similar  behavioral  characteristics,  specific  dyads,  one-way 

flows  for  all  indicators,  and  for  initiators  and  recipients 

must  be  examined  and  compared  for  effectiveness  of  early 
4 8 

warning.  Generation  of  probabilities  for  the  other  inter- 
national political  indicators  currently  in  the  system  should 
also  be  explored  as  must  probabilities  for  the  military  and 

31 

See  Andriole  (1977a)  for  elaboration  of  these  notions. 
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economic  indicators  to  be  integrated  into  the  prototype 
system.  The  flexibility  of  the  interactive  P-tables  program 
will  facilitate  testing  in  all  these  areas. 

The  program  will  also  be  a useful  tool  for 
carrying  out  research  for  the  blend  of  subjective  and  objec- 
tive methodologies.  The  analyst  can  observe  the  quantitative 
indicators  and  their  probabilities,  evaluate  them  in  terms 
of  his  own  expertise,  modify  them  and  then  compare  them 
retrospectively  and,  eventually,  in  a real-time  mode. 

Finally,  in  terms  of  development,  the  variants 
of  the  probability  conversion  tables  will  be  dynamic.  This 
dynamism  stems  not  only  from  the  capability  to  input  analyst- 
generated probabilities  (subjective  and/or  objective) , but 
from  periodical  updates.  Global  P-tables  are  presently 
based  on  twenty-seven  crises  which  occurred  between  1966-75. 
This  will  shortly  be  updated  by  adding  crises  occurring 
since  1975  and  by  basing  P-tables  on  the  most  reliable 
version  of  WEIS.  It  must  be  determined  if  the  few  frequency 
differences  between  that  data  and  the  data  used  to  generate 
global  P-tables  will  affect  them.  As  the  number  of  crises 
on  which  P-tables  are  based  grows,  our  inferences  from  past 

to  future  crisis  occurrence  will  increase  in  reliability  and 
49 

validity. 

4.2.3  Problems  and  issues  revealed  by  testing.  In  a 
preliminary  attempt  to  remedy  long-standing  neglect  of  the 
evaluation  and  thresholding  components  of  the  monitoring 
process,  and  to  address  the  myriad  questions  raised  in  the 
preceding  sections,  this  section  focuses  on  problems  and 
issues  associated  with  evaluation  and  thresholding  for 
monitoring  and  warning.  The  purpose  of  the  section  is  to 
raise  questions  for  future  research,  not  to  provide  answers. 

49 

For  elaboration  on  this  statement  see  McClelland 

(1969)  . 
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Nor  is  there  any  attempt  to  address  all  the  problems;  only 
those  that  are  immediately  apparent  from:  (1)  application  of 
the  Early  Warning  and  Monitoring  System  to  many  historical 
cases  and  (2)  interaction  with  I&W  analysts,  will  be  dis- 
cussed. 


In  our  research  with  a prototypical  computer- 
based  monitoring  and  warning  system,  we  have  learned  that 
there  are  many  specific  problems  and  issues  not  treated  by 
general  conceptual  discussions.  These  include:  differen- 
tiating signals  from  noise,  differentiating  exercises  from 
crises,  information  retrieval  vs.  monitoring,  relating 
thresholds  to  warning  purposes,  relating  warning/monitoring 
to  action/decision,  and  clarifying  the  purposes  of  warning. 


A preliminary,  non-comprehensive  list  of  problems 
and  issues  revealed  by  our  research  as  well  as  interaction 
with  potential  users  is  as  follows: 


Monitoring 

• Targets  of  Monitoring 

What/who  should  be  tracked? 

• Evaluation/Interpretation 

How  can  signals  be  separated  from  noise? 

How  should  context  be  interpreted? 

Are  diverse  indicators  tracking  different 
phenomena? 

How  are  the  indicators  related? 

How  should  different  signals  be  weighted? 

How  should  conflicting  signals  be  integrated? 

Warning 

• Timing 

When,  how  often  should  a warning  be  given? 

• Generalization 

How  much  pattern  recurrence  is  required  for 
warning? 


i 


124 


Thresholds 

What  are  the  costs  and  benefits  to  analysts 
of  different  thresholds? 

What  are  analyst  preferences  for  false  alarms 
vs.  misses? 

Must  thresholds  be  country-,  region-,  dyad- 
specific? 

Theory 

Is  theoretical  knowledge  useful  for  warning 
or  vice  versa? 

A multitude  of  problems  associated  with  "crisis," 
and  exercises,  e.g.: 

What  definition (s)  should  be  used? 

How  many  types  of  crises  are  there  and  what 
are  the  patterns  associated  with  each? 

Is  it  possible  to  provide  warning  of  all 
types  of  crises? 

How  can  exercises  be  differentiated  from 
mobilizations? 


Targets  of  Monitoring:  The  not-so-easy  answer 
to  what  or  who  should  be  tracked  is--any  country  that  might 
be  potentially  involved  in  a crisis  or  conflict.  Analysis 
of  the  1967  Middle  East  War  (Daly  1978)  suggests  that  an 
analyst  tracking  just  the  U.S.  and  Soviets  with  the  Early 
Warning  and  Monitoring  System  in  May  1967  might  have  been 
able  to  forecast  the  June  War  in  the  Middle  East.  Of  course, 
the  number  of  possible  networks  which  might  be  monitored  is 
virtually  limitless,  which  may  partly  explain  the  reluctance 
of  real-world  analysts  to  consider  the  activities  of  countries 
outside  their  area  of  responsibility,  even  when  these  activ- 
ities may  have  a great  impact  on  their  region  of  concern. 

A possible  solution  to  the  targeting  problem 
would  be  an  automatic  scan  of  potential  conflict  networks. 

For  example,  if  conflict  or  tension  indicators  for  the 
North-South  Korea  country-pair  reached  a certain  level,  the 
computer  would  automatically  check  and  report  back  on  the 
indicators  for  KON-CHN  and  KOS-USA."^  An  autoscan  might 


Thanks  to  Steve  Andriole  for  the  concept--"Intelligent 
I&W"--of  which  autoscan  is  a part. 
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also  include  a report  from  the  computer  as  to  which  countries 
had  strong  military  commitments  ties  (as  measured  by  Martin's 
index--Martin  1976  and  1977a)  to  the  salient  country  pair. 


Evaluation/ Interpretation : This  problem  com- 
prehends a great  variety  of  issues  found  in  both  basic 
research  and  in  the  operational  environment.  Only  a few  are 
suggested  here.  There  are  massive  problems  with  such  things 
as  separating  signals  from  noise,  interpretation  of  context, 
and  weighting  different  indicators  for  military  and  political 
warning  or  monitoring  systems  considered  independently . 

These  problems  may  be  exacerbated  by  an  amalgamation  of  such 
systems  or  by  joint  consideration  of  their  signals. 

However,  amalgamation  may  also  help  solve  problems 

of  evaluation  and  interpretation.  For  example,  the  lead 

that  political  indicators  generally  have  on  military  ones 

would  suggest  at  least  two  paths  of  evaluation  to  an  analyst 

faced  with  increasing  verbal  conflict  for  a particular 
52 

country-pair.  First,  he  might  pay  closer  attention  to 
physical  conflict  as  measured  by  political  indicators  as 
well  as  to  other  political  indicators.  Their  performance 
should  help  him  evaluate  the  "noisiness"  of  the  verbal 
conflict.  Second,  he  might  track  a variety  of  military 
indicators,  especially  those  which  have  historically  been 
best  at  longer  term  warning.  Political  indicators  may  not 
only  provide  longer  lead  time  but  they  may  help  distinguish 
exercises  from  an  actual  conflict.  Working  the  other  way, 
political  indicators  may  help  unravel  the  context,  may  point 
to  the  target  of  elevation  in  a country's  military  indicator (s) 
when  these  indicators  do  not  explicitly  distinguish  a poten- 
tial target. 

"^For  illustrations  of  these  problems  as  suggested  by 
application  of  a political  indicator  system  to  two  Middle 
East  crises,  see  Daly  (1978). 

52 

For  analysis  and  examples  of  the  warning  that  verbal 
conflict  gives  of  physical  conflict  see  Davies  (1978b). 
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Timing  and  Generalization:  Both  these  problems 
have  been  illustrated  by  analyses  of  historical  crises 
(Daly  1978) . They  are  best  discussed  in  the  context  of  the 
problem  of : 

Thresholds ; As  illustrated  in  Figure  3-1, 
setting  thresholds  minimally  involves  considerations  of 
hits,  misses,  false  alarms,  and  correct  rejections.  How- 
ever, the  relative  importance  of  these  considerations  varies 
widely  depending  on  the  purpose  of  the  warning  process.  For 
example,  the  Early  Warning  and  Monitoring  Project  is  rut  yet 
responsible  to  crisis  decision  makers.  We  are  therefore 
developing  thresholds  from  analysis  of  historical  hit  rates 
of  our  indicators.  (Daly  and  Bell  1977a;  Daly  1977;  and 
Davies  1977)  For  a real-world  I&W  analyst,  however,  these 
empirically  derived  thresholds  may  be  associated  with  in- 
tolerable miss  or  false  alarm  rates.  Eventually,  therefore, 
the  system  must  allow  the  analyst  the  option  of  setting 
thresholds  himself  and  provide  him  with  the  implications  (in 
terms  of  overall  warning  success)  of  his  threshold  based  on 
historical  empirical  results.  While  determination  of  the 
development  of  extant  military  indicator  systems  is  certainly 
not  within  our  purview,  research  on  threshold-setting  with 
these  systems  would  enhance  and  facilitate  threshold-setting 
for  the  Early  Warning  and  Monitoring  System.  If  thresholds 
were  developed  for  military  indicators,  a great  deal  could 
be  learned  by  comparison  and  cross-checking  of  political  and 
military  indicator  thresholds. 

Other  thresholding  problems  that  have  arisen 
with  the  political  indicator  system  may  occur  with  military 
ones  as  their  coverage  is  expanded.  Extensive  research  with 
the  political  indicator  system  suggests  that: 

• Even  if  retrospective  analysis  of  interactions  of 
the  key  participants  in  a particular  pre-crisis 
period  in  a specific  region  seems  to  reveal  sig- 
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nals  or  patterns  leading  to  the  crisis,  it  cannot 
be  claimed  that  the  system  can  provide  warning  of 
such  events.  One  case  does  not  a threshold  make. 


It 


has  been  argued  (Daly  1977)  that  the  history  of 


different  regions  and  networks  of  countries  neces- 


sitates development  of  region-specific  indicators. 
If  the  indicator  algorithms  which  provide  the  best 


warning  and  monitoring  for  a region  differ  from 
"global"  algorithms,  it  is  probable  that  any 
patterns  which  forecast  cooperation  or  conflict  in 
a region  cannot  be  generalized. 


Theory : The  question--Is  theoretical  knowledge 

useful  for  warning  or  vice  versa? — comprehends  a variety  of 
subissues,  the  most  salient  in  the  present  context  having  to 
do  with  acceptance  of  interactive,  computer-based  warning 
and  monitoring  systems  by  the  "typical"  I&W  analyst.  The 
question  as  stated  has  already  been  answered  in  the  affir- 
mative; the  problem  is  to  demonstrate  to  analysts  that  there 
is  a synergism  between  their  " theory"--experience , expertise, 
traditional  wisdom,  non-quantitative  training--and  a system 
founded  on  methods  in  which  they  were  not  trained  using 
computer  technology  with  which  they  are  unfamiliar. 


Retrospective  analyses  (Andriole  1976a  and  1976b; 
and  Daly  1977)  suggest  that  such  systems  could  have  provided 
warning  of  historical  crises.  In  addition,  such  systems 
might  help  meet  the  information  processing  requirements  of 
the  I&W  analyst  and  provide  him  with  alternative  estimates 
and  indicators.  Such  systems  are  intended  to  assist,  not 
replace,  human  judgment.  The  problem  is  to  convince  analysts 
that  computer-based  systems  can  assist  them,  can  make  their 
jobs  easier.  It  must  be  demonstrated  to  analysts  that 
quantitative  indicator  systems  can  supplement  their  years  of 
experience,  give  them  a different  perspective  on  warning, 
enhance  the  prevailing  theory,  and  even  perhaps  play  a 
devil's  advocate  role. 
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There  are,  of  course,  several  ways  of  obtaining 
user  acceptance:  training  on  extant  computer-based  systems, 
development  of  tutorial  and  expert  versions,  remaining 
cognizant  of  user  needs  and  desires  and  designing  the  system 
to  meet  them  in  a flexible  manner,  and  achieving  demonstrable 
success  in  warning  and  monitoring.  All  these  ways,  and  many 
others,  of  obtaining  user  acceptance  must  be  explored  so 
that  we  may  demonstrate  the  synergism  of  I&W  theory  with 
interactive  computer-based  warning  and  monitoring  systems. 

4.2.4  Computer  base.4 5^  This  section  documents  the 
development  of  EWAMS  software  and  describes  its  current 
status.  The  discussion  will  fall  into  two  major  categories: 
computer-based  software  and  Tektronix  4051  standalone  soft- 
ware. Table  4-43  provides  a list  of  programs  to  be  discussed 
under  both  categories,  while  Figure  4-20  graphically  traces 
their  evolution. 

Computer-Based  Software  (Summary  1/76-1/77) : In 
January  of  last  year  seven  project  support  and  test  programs 
were  surveyed.  Summarily,  the  survey  included  (Wittmeyer  1977) 

1.  PROGRAM  SCAN  - used  to  collect  total  frequencies 
for  sixteen  actor  nations  from  WEIS  for  660101- 
691231. 

2.  PROGRAM  REBUILD  - used  to  construct  a new  data 
base  of  thirteen  countries  from  WEIS.  The  reduced 
data  base,  written  as  a random  file,  contains  all 
dyadic  matches  between  the  thirteen  nations  as 
actors  and/or  recipients  and  is  used  by  program 
-CRISIS  (now  referred  to  as  -THEN) . 

3.  PROGRAM  WINDEX  - used  to  convert  the  sequential 
WEIS  data  set  to  a random  access  file  to  avoid  a 
slow  sequential  search. 

4.  PROGRAM  ARENA3  - used  to  count  dyadic  totals  in 
any  given  region  by  day  over  ten  years. 

S3 

This  section  borrows  heavily  from  Bell  (1978)  . 
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PROGRAM 

COMPLETION  DATE 

LANGUAGE* 

AUTHOR (S) 

Computer- 

Based 

-CRISISl-THEN) 

September  1976 

SFO 

Allen 

Wittmeyer 

Randall 

PROGRAM  a INDEX 

July  1976 

SFO 

Randall 

PROGRAM  SCAN 

March  1977 

SFO 

Wittmeyer 

PROGRAM  REBUILD 

March  1977 

SFO 

W'ittmeyer 

FROG  RAM  ARENAS 

March  1977 

SFO 

Wittmeyer 

FROCRAM  CROSST 

March  1977 

SFO 

Wittmeyer 

PROGRAM  "ANALYC 

March  1977 

SFO 

Wittmeyer 

-NOW 

January  1977 

SFO 

Wittmeyer 

EFI 

June  1977 

RT-11 

Wittmeyer 

PROBS 

July  19’7 

Fortran 

IV  Plus 

Bell 

QCSI 

July  1977 

RT  or 

RT-11 

Wittmeyer 

Bell 

THEN  II 

December  19'7 

Fortran 

IV  Plus 

Bell 

UFWE1S 

January  1978 

Fortran 

IV  Plus 

Bell 

NOW  II 

January 

Fortran 

IV  Plus 

Bell 

Standalone 

ro: 

July  1977 

Basic 

Wittmeyer 

TENSION 

September  1977 

Basic 

Bell 

YULE'S  Q 

September  1977 

Basic 

Bell 

PERCENT 

November  1977 

Basic 

Bell 

Harrison 

PROBE 

January  1978 

Basic 

Harrison 

•SFO  i»  United  Computing  System'*  extended  Fortran  IV. 

Table  4-43 

EARLY  WARNING  AND  MONITORING  SYSTEM  PROJECT  SOFTWARE 


<*: 

♦ 


ARENA3 


UPWEIS 


PROBE 


Figure  4-20 

EARLY  WARNING  & MONITORING  SYSTEM  COMPONENTS 
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5.  PROGRAM  CROSST  - used  to  read,  collect,  and  output 
dyadic  frequencies  for  three  flow  directions  for  six 
event  categories  by  quarter  over  ten  years. 

6.  Mutations  of  -CRISIS  ("ANALYZ")  - several  modifi- 
cations of  -CRISIS  addressed  to  a variety  of 
experimental  statistical  procedures  and  data 
management  processes. 

-CRISIS,  known  to  potential  users  as  the  "Historical 
Version"  and  to  project  staff  as  -THEN  I,  is  described  in 
detail  in  Software  Design  for  an  Interactive  Crisis  Early 
Warning  Prototype  System  (Wittmeyer  1976)  . All  the  above 
programs  were  contributors  to  or  spin-offs  from  -CRISIS. 

All  of  them,  including  -CRISIS,  were  developed  and  used  on  a 
commercial  time-sharing  system  and  were  implemented  in  an 
extended  Fortran  language,  UCS  Super  Fortran. 

Computer-Based  Software  (Developments  since 
January  1977) : 

-NOW;  The  master  program  -THEN  I was  joined  in 
February  1977  by  -NOW.  Developed  on  a commercial  time- 
sharing system,  this  version  had  all  the  features  of  -THEN 
but  was  front-ended  by  JCS  regions  and  accessed  all  of  WEIS, 
not  merely  the  seven  countries  in  -THEN  I.  It  was  comprised 
of  eighteen  18  separate  data  sets.  The  program  allowed  the 
analyst  to  look  at  country  pairs  within  JCS  regions,  a 
regional  actor  and  any  other  country  in  the  world  or  all 
countries  in  toto , the  superpowers  as  a region,  and  to 
create  his  own  region.  -NOW  was  the  "Real-Time  Version"  of 
the  Early  Warning  and  Monitoring  Demonstration  System. 

However,  it  was  "real-time"  only  in  terms  of  our  latest  WEIS 
data,  at  that  time,  through  December  1976. 

EFI ; This  was  a preliminary  attempt  to  modify 
McClelland's  (1976)  EFI  indicator  for  the  11/70.  The  soft- 
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ware  design  developed  then  will  be  useful  in  adapting  EFI  as 
a systemic  indicator  in  NOW  II. 

PROBS ; This  program  was  written  to  permit 

testing,  evaluation,  and  dynamic  modification  of  the  Early 
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Warning  and  Monitoring  System  probabilities.  PROBS  is 
modular  and  lends  itself  easily  to  modification.  Data 
availability  necessitated  that  probability  conversion  tables 
be  based  on  two-way  interaction,  crisis  and  non-crisis 
periods,  progressive  z-scores,  and  independent  value  groupings 
(class  intervals) . However,  PROBS  allows  the  analyst  flexi- 
bility in  selection  of  crisis  cases,  flows,  type  of  z- 
scores,  intervals,  and  "correction"  factors. 

PROBS  employs  a straightforward  approach  in  its 
generations  of  probabilities.  The  program  requires  as 
input:  a sequential  copy  of  WEIS;  the  NATION  file;  and  DOC 
(Dates  of  Crisis)  file. 

Output  from  PROBS  includes:  tables  displaying 
the  frequency  of  z-scores  in  crisis  and  non-crisis  periods 
over  any  number  of  cases  for  total,  cooperative,  and  con- 
flictual  categories;  row  percentages  of  z-scores  at  given 
levels  and  corollary  probabilities;  and  the  effect  of  various 
weighting  factors  on  these  probabilities. 

Also  included  as  output  is  a file  'DOUT.'  If 
the  analyst  desires  to  see  dyadic  tables  for  each  crisis 
case,  he  may  obtain  frequencies,  z-scores,  and  probabilities 
for  each  case. 

QCSI  (Quality  Control  Safeguard) : QCSI  was  a 
partial  conversion  of  -THEN  from  a commercial  time-sharing 
service  to  the  DARPA/DDI  PDP  11/70.  The  program  was  con- 
verted to  the  RT-11  Princeton  Fortran  language,  modified  for 

P-. 

The  source  code  for  PROBS  as  well  as  a report  on  sub- 
stantive findings  generated  with  it  can  be  found  in  Daly  and 
Bell  (1977b) . 


UNIX,  and  uses  Plot-10  (TCS)  graphics.  QCSI  consisted  of 
four  major  programs  simulating  the  overlay  concept  used  in 
both  -NOW  and  -THEN. 

THEN  II:  THEN  II  was  an  upgrade  of  QCSI. 

Developed  on  CTO's  Demonstration  and  Development  Facility 
(DDF)  PDP  11/70,  it  used  the  more  extensive  capabilities  of 
Fortran  IV-Plus  and  some  of  the  graphics  from  -THEN. 

UPWE IS ; UPWEIS  is  used  to  update  each  record  of 
the  WEIS  file  to  include  regional  codes  for  all  initiators 
and  targets.  The  updated  WEIS  file  replaces  the  eighteen  data 
sets  used  by  the  program  -NOW.  It  therefore  makes  the  JCS 
regional  front  end  of  NOW  II  much  more  efficient. 

NOW  I I : NOW  II  is  the  current  "master"  version 
of  the  Early  Warning  and  Monitoring  System.  It  combines  the 
best  features  of  THEN  II  and  NOW  I,  and  adds  some  new  ones, 
for  example: 

a regional  filter  for  JCS  regions  and  build-your- 
own  regions; 

AG I I graphics  (less  the  calendar  data  feature); 
daily  data  from  1966  to  the  present; 
descriptive  data. 

In  its  current  configuration  NOW  II  is  the 
master  version  into  which  tested  and  evaluated  research 
results  are  integrated.  Examples  of  such  results  include 
improved  indicator  algorithms,  new  political  indicators  such 
as  regional  EFI  and  regional  ROZ , moving  windows,  and  dif- 
ferent combinations  of  plots.  For  the  present,  major  research 
and  development  efforts  such  as  those  on  military  and  economic 
indicators  will  be  kept  separate.  It  must  always  be  kept  in 
mind,  however,  that  political,  economic,  and  military  indi- 
cators must  all  eventually  reside  in  an  integrated  Early 
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Warning  and  Monitoring  System.  All  research  should  be 
designed  to  facilitate  this  integration. 

Software  on  t,he  Standalone  4051  : Much  project 
software  also  runs  on  a standalone  Tektronix  4051.  This 
software  serves  a dual  purpose.  First,  the  results  of 
research  done  with  many  of  these  programs  has  been  or  will 
be  integrated  into  the  master  version,  NOW  II.  Second,  all 
the  software  is  interactive  and  virtually  self-explanatory 
so  that  it  can  be  used  not  only  by  project  analysts  but  by 
potential  users  in  the  Intelligence  Community  as  a supple- 
ment to  their  efforts  on  -NOW  II.  All  the  standalone  soft- 
ware is  written  in  BASIC.  ROZ  requires  an  8K  machine  while 
the  other  programs  require  32K. 

ROZ ; A PDP  11/70  was  used  to  generate  monthly 
frequencies  of  events  initiated  by  each  of  183  countries 
from  January  1976  to  March  1977.  This  output  was  generated 
by  a program  which  checked  each  event  and  matched  the  ini- 
tiator's country  code  against  its  position  in  the  NATION 
file.  If,  for  example,  the  initiator  nation  was  RHO  (Rhodesia), 
then  it  was  matched  and  placed  in  the  proper  124  position. 

This  was  done  for  each  of  the  fifteen  months  for  all  183 
nations,  organizations,  and  groups. 

The  process  that  followed  was  also  very  straight- 

A program  was  written  to  input  this  data  matrix 
(fifteen  months  by  183  nations)  to  a 4051  internal 
cassette  tape. 

A data  check  program  was  used  to  test  the  validity 
of  the  file  created  in  Step  1. 

A utility  copy  program  was  written  to  insure  a 
back-up  copy. 

Finally,  a standalone  BASIC  program  was  written 
that  would  read  the  data  tape,  search  for  an 
individual  nation  (in  order  of  the  NATION  file), 
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forward : 
1) 

2) 

3) 

4) 





and  calculate  z-scores  and  ROZ  output  based  upon 
the  percentage  of  events  initiated  by  that  nation 
for  the  given  month.  One  other  required  input  to 
the  standalone  ROZ  is  McClelland's  number--the 
percentage  of  total  events  of  that  country  for  the 
period  1966-75  (McClelland  1976)  . 

Although  written  in  BASIC,  a version  of  the 
standalone  ROZ  program  can  and  will  be  converted  to  FORTRAN 
on  the  DDF  PDP  11/70  in  the  near  future.  One  area  to  be 
explored  is  a combination  of  an  improved  version  of  the 
summary  and  frequencies  program  (by  any  time  increment)  with 
the  conversion  of  the  ROZ  routines  to  FORTRAN  to  display  a 
rank  order  of  the  most  volatile  to  least  volatile  nations. 

The  resultant  program  would  provide  a barometer- like  capa- 
bility which  would  allow  the  user  to  see  which  countries  are 
or  are  not  upsetting  the  world  systemic  flows. 

TENSION : Like  ROZ,  the  results  of  the  standalone 

program  TENSION  have  improved  the  master  version  of  the 
Early  Warning  and  Monitoring  System  residing  on  the  DDF 
11/70.  TENSION  was  written  to  permit  research  for  improving 
the  tension  indicator.  It  is  interactive  and  allows  the 
analyst  to  calculate  tension  levels  for  any  country-pair, 
flow,  and  time  period,  and  to  designate  crisis  periods.  The 
analyst  can  apply  any  or  all  of  four  weighting  factors  to 
the  data.  The  findings  generated  with  TENSION  have  resulted 
in  modification  and  improvement  of  the  tension  algorithm  in 
the  master  version  and  have  been  used  to  examine  regional 
tension  in  the  Mideast  (Daly  1977)  . 

YULE'S  Q;  While  YULE'S  Q55  was  initially  written 
to  continue  the  research  begun  with  TENSION,  it  is  indepen- 
dent of  the  latter  and,  especially  in  its  second  generation 

■’"’For  source  code,  see  Daly  and  Bell  (1977a).  For 
substantive  findings  based  on  the  program,  see  Daly  and 
Bell  (1977a)  and  Daly  (1977a). 
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as  PERCENT,  has  a great  variety  of  current  and  potential 
applications . 


C 


* 


c 


Yule's  Q is  a measure  of  association  for  2X2  tables. 

It  was  initially  used  to  compare  the  historical  correspondence 
between  indicator  signals  and  reality  for  twenty-seven  crises 
and  thereby  to  evaluate  the  alternative  tension  levels 
generated  with  TENSION.  The  program  allows  the  analyst  to 
calculate  Yule's  Q over  as  many  cases  as  desired  and  for 
various  weights  and  thresholds.  The  program  also  calculates 
the  percentages  of  hits,  misses,  false  alarms,  correct 
rejections,  and  the  overall  success  rate  for  the  selected 
combination  of  cases,  weights,  and  thresholds. 

PERCENT;  Like  YULE'S  Q,  its  successor,  the 
program  PERCENT,  has  applications  far  beyond  its  initial 
purpose.  The  program  was  written  to  permit  more  detailed 
analysis  of  the  2x2  tables  generated  by  TENSION  and  analyzed 
by  YULE'S  Q.  It  calculates  row,  column,  and  total  per- 
centages over  any  number  of  cases  for  both  weighted  and 
unweighted  tension  and  for  a variety  of  thresholds.  The 
program  has  allowed  us  to  evaluate  many  tension  algorithms 
and  thresholds  and  to  determine  the  most  valid  and  reliable 
one.  Results  of  this  research  will  be  integrated  into  the 
master  version  of  the  Early  Warning  and  Monitoring  System. 

PERCENT  can  be  used  to  perform  similar  research  and  evalua- 
tion on  other  indicators. 

PROBE ; Program  PROBE  is  designed  to  allow  the 
analyst  to  examine  the  pattern  of  cooperative  and  conflic- 
tual  events  in  crisis  and  non-crisis  periods.  PROBE  computes 
and  displays  in  tabular  and  graphics  format  probabilities 
for  all  twenty-two  event  types.  Preliminary  research  using 
this  program  indicates  that  new  quantitative  political 

■^For  details  on  this  program  see  Davies  (1977). 
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indicators  based  on  verbal  and  physical  event  types  substan- 
tially improves  the  warning  and  monitoring  capabilities  of 
the  system. 


Software  Plans--ll/70-Based : Modifications  will 
continue  to  be  made  to  NOW  II,  the  master  version  of  the 
Early  Warning  and  Monitoring  System.  These  will  be  rela- 
tively minor  and  incremental,  reflecting  results  of  research 
on  specific  and  narrow  aspects  of  the  system.  On-going  and 
planned  research  efforts  whose  results  will  eventually 
quietly  appear  in  NOW  II  include: 

probability  plots 
global  and  regional  EFI 
rates  of  change 
thresholding  all  indicators 
probs  from  tension 

a modified  HREL,  or  indicator  to  replace  it 

- all  vs.  all  indicators 
moving  windows 

research  with  special  data  sets 
ROZIN  and  REGROZ 
regional  HREL 
maps 

daily  data 

- autoscan. 

Work  will  also  continue  on  economic,  military, 
domestic,  and  cross-national57  indicators.  These  efforts 

57For  details  on  domestic  and  cross-national  indicators 
see  Wilkenfeld  and  Hopple  (1977). 
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will  be  kept  separate  from  NOW  II.  When  rigorous  testing 
reveals  that  economic,  military,  and/or  domestic  indicator 
systems  are  sufficiently  developed  to  be  integrated  with 
international  political  ones,  NOW  II  will  die  and  be  re- 
placed with  a new  version  of  the  Early  Warning  and  Moni- 
toring System,  hopefully  one  with  a more  euphonious  appella- 
tion. Writing  the  software  for  such  an  integration  will  be  a 
formidable  task,  made  feasible  only  by  designing  and  developing 
a new  version  of  the  warning  system. 

Software  Plans — Standalone;  Given  the  existence 
of  DDF,  the  last  year's  emphasis  on  standalone  research  and 
test  programs  will  decrease.  However,  attention  to  stand- 
alone capabilities  will  continue  in  two  forms. 

First,  the  availability  of  the  Tektronix  4097 
floppy  disk  renders  the  development  of  a standalone  Early 
Warning  and  Monitoring  System  demo  eminently  feasible  and 
practical.  A 4051/floppy  combination  means  that  the  system 
can  be  shown  to  (and  even  eventually  used  by)  potential 
users  anywhere  in  the  world  who  have  no  access  to  a host 
computer . 


The  4907  is  a direct  access,  flexible  disc 
device  for  the  4051.  It  is  built  around  a microprocessor  to 
handle  file  management  and  directory  tasks.  Single,  dual, 
and  triple  disc  drives  are  available  allowing  up  to  1.89 
million  bytes  of  storage. 

The  floppy  will  permit  data  transfer,  sorts  and 
merges  to  be  accomplished  with  a minimum  of  programming. 
Program  overlaying,  chaining,  and  appending  are  performed  in 
a fraction  of  the  time  required  when  using  the  tape  storage. 
Directory  and  file  management  capabilities  allow  ease  in 
storing  and  retrieving  programs  and  data  files. 


Overall,  the  4051  coupled  with  the  4907  will 
serve  as  a compact  computing  system  with  local  control, 
convenient  storage  medium,  and  enough  computing  power  to 
adequately  "substitute"  for  a large  computer  system. 

The  second  thrust  of  a continued  standalone 
effort  will  focus  on  a compilation  of  utility  packages  to 
aid  project  analysts  as  well  as  potential  users  in  the 
Intelligence  Community.  Admittedly,  not  all  of  those  to 
whom  the  System  is  transferred  will  have  any  desire  to  go 
beyond  the  options  in  NOW  II.  For  those  who  do  however,  we 
should  be  prepared  to  provide  interactive,  easy-to-use 
routines  compiled  in  an  Analyst  Research  Assistance  Package. 
Such  a package  might  include  the  extant  TENSION,  YULE'S  Q, 
PERCENT,  and  PROBE  as  well  as  simple  statistical  routines. 

As  with  all  aspects  of  the  Early  Warning  and  Monitoring 
System,  we  shall  continue  to  solicit  input  from  potential 
users  on  ways  in  which  the  11/70-based  and  standalone  software 
might  better  address  their  needs. 


5.0  DEMONSTRATION  AND  TRANSFER  OF  THE 
EARLY  WARNING  AND  MONITORING  PROTOTYPE  SYSTEM 


5.1  Demonstration 


Appendix  C presents  a partial  listing  of  those  who  have 
viewed  an  EWAMS  demonstration.  Since  DDF  allows  access  to 
EWAMS  from  anywhere  in  the  country  (including  DIA/NMIC) , the 
list  of  those  who  have  seen  the  demo  and  experimented  with 
EWAMS  is  undoubtedly  much  longer. 

The  development  and  demonstration  versions  of  EWAMS  are 
currently  one  and  the  same.  This,  plus  the  excellent  facili- 
ties of  DDF  and  the  support  of  its  highly  competent  per- 
sonnel, means  that  potential  users  are  exposed  to  EWAMS 
"state  of  the  art."  Furthermore,  improvements  and  modifica- 
tions are  immediately  available  to  users.  This  is  benefi- 
cial to  project  staff  since  users,  e.g.,  at  DIA/NMIC,  can 
provide  instant  evaluations  on  modifications  to  EWAMS. 

5. 2  Transfer 

Transfer  of  EWAMS  to  one  user  group  is  currently  being 
conducted  under  the  terms  of  the  ARPA/DIA  Memorandum  of 
Understanding.  It  is  anticipated  that  transfer  to  other 
parallel,  off-line  testbeds  will  occur  at  the  direction  of 
the  COTR. 

DIA/NMIC  currently  accesses  EWAMS  on  DDF  with  a Tek- 
tronix 4051  in  the  NMIC.  Supervisory  personnel  have  been 


141 


trained  on  EWAMS  and  they  in  turn,  along  with  project  per- 
sonnel, are  introducing  the  system  to  NMIC  analysts.  A 
forthcoming  EWAMS  Users  Manual  will  supplement  the  informal, 
ad  hoc  transfer  process.  The  informality  of  the  transfer 
process  has  been  of  great  benefit  to  the  development  of 
EWAMS.  User  needs  and  desires  have  been  easily  solicited 
and  translated  into  system  modifications. 

All  potential  users  who  see  the  system  are  queried  as 
to  whether  they  would  rather  have  a "novice"  or  "expert" 
version  of  the  system.  A novice,  tutorial  version  for  the 
inexperienced  would  have  step-by-step  instructions  and  lists 
of  options.  It  would  also  be  fairly  rigid  in  terms  of 
ordering  of  analysis  and  would  require  a fairly  large  com- 
puter capacity.  An  expert  version  of  the  system  would  be 
very  flexible,  allowing  the  user  to  jump  from  one  type  of 
analysis  to  another  with  simple  one-word  commands.  Either, 
both,  or  a compromise  system  can  be  designed  with  input  from 
potential  users  being  the  key  consideration. 

In  addition  to  maintaining  maximum  user  ease  and  flexi- 
bility, the  software  is  being  developed  with  the  objective 
of  maintaining  maximum  compatibility  with  the  hardware  and 
software  of  both  potential  users  and  of  other  computer-based 
projects  in  the  Crisis  Management  Program.  The  technical, 
though  not  necessarily  operational,  goal  is  a computer- 
based,  fully-integrated  crisis  early  warning/management 
system. 

The  packaging  and  distribution  of  EWAMS  software  is 
compatible  with  CULC  Fortran  IV-Plus  for  UNIX  and  AG  II 
graphics.  At  CTO  request  and  the  directions  of  the  COTR,  we 
are  consulting  and  assisting  in  the  conversion  and  transfer 
of  the  PDP  11/70  software  to  user  facilities. 


6.0 


THE  BLEND  OF  EMPIRICAL  AND 
DECISION  ANALYTIC  I&W 


6 . 1 Current  Status 

The  blend  of  empirical  and  decision-analytic  method- 
ologies for  I&W  is  still  in  the  basic  research  stage.  The 
next  section  illustrates  some  problems  with  development  of 
the  blend,  while  Section  6.3  discusses  its  potential.  Since 
DIA/NMIC  is  currently  using  decision-analytic  aids  and 
models,  research  on  the  blend  of  methodologies  has  been 
facilitated  by  the  ARPA/DIA  Memorandum  of  Understanding.  In 
the  NMIC  context,  blend  research  is  focusing  on  the  con- 
ceptual linkage  of  empirical  and  decision-analytic  models, 
indicator  scale  conversions  necessary  for  such  linkage,  and 
retrospective  analyses  of  historical  case  studies  using  both 
methodologies . 

In  the  context  of  the  Early  Warning  and  Monitoring  Proj- 
ect, the  purposes  of  the  blend  of  empirical  and  subjective 
methodologies  are  to:  1)  generate  additional  indicators  for 
I&W  and  to  test  and  evaluate  extant  ones;  2)  compare  and 
evaluate  empirically  and  subjectively  generated  probabilities; 
3)  generate,  compare,  and  evaluate  utilities  produced  with 
the  two  methodologies;  and  4)  provide  the  Defense  community 
with  a flexible  and  efficient  tool  combining  the  best  of  two 
separate  but  synergistic  methodologies  for  I&W.*  Underlying 

For  more  on  these  purposes  and  methodologies,  see 
Andriole  (1976a)  and  Decisions  and  Designs,  Incorporated 
(1977a) . 
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these  purposes  is  the  assumption  that  indicators,  proba- 
bilities, and  utilities  derived  with  two  independent  method- 
ologies can  be  compared  and  evaluated  in  parallel,  linked 
component  by  component,  and  perhaps  eventually  integrated 
both  logically  and  in  a single  computer-based  system.  The 
research  on  indicators,  probabilities,  and  utilities  is 
serving  to  confirm  or  disconfirm  the  assumption.  Initial 
research  is  in  the  form  of  case  studies  to  explore  the 
compatibility  of  two  decision  analysis  models  and  one  Bayesian 
hierarchical  inference  model  with  the  empirical  data,  indi- 
cators, and  probabilities  of  the  Early  Warning  and  Monitoring 
Project. 

6 . 2 Problems 

From  the  perspective  of  the  Early  Warning  and  Monitoring 

Project,  there  are  several  problems  or  criteria  for  evalua- 

, 2 

tion  of  the  compatibility  of  decision-analytic  models  with 

the  project's  empirical  data,  methods,  and  output.  Without 
categorizing  them  as  ideal,  desirable,  necessary,  or  suffi- 
cient, these  non-mutually  exclusive  criteria  are  product, 
dynamism,  probabilities,  thresholds,  flexibility,  and  input 
data."*  More  specifically,  the  criteria  of  compatibility 
refer  to: 


Product : Is  the  output  of  the  model  addressed  more  to 

decision  making  or  to  monitoring  and  forecasting,  i.e., 
to  determination  of  the  best  option  or  system  or  to 
determination  of  the  likelihood  of  an  event?  Those 
familiar  with  decision-analytic  models  are  aware  that 
"either/or"  statements  of  their  products  are  inaccurate; 
however,  examination  of  the  models  in  terms  of  the 
above  criteria  suggests  their  products  can  be  placed  at 
different  points  on  a continuum.  In  the  present  stage 
of  development  of  the  Early  Warning  and  Monitoring 


For  the  sake  of  brevity,  "decision-analytic  models" 
refers  also  to  Bayesian  hierarchical  inference  ones. 

"^Decision  analyst  readers  are  forewarned  that  these 
criteria  have  been  developed  by  novices  in  decision  analysis 
and  are  based  on  examination  of  only  three  models--EVAL , 
OPINT,  and  HIER. 
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System,  a model  whose  product  emphasizes  forecasting  or 
facilitates  warning  is  preferable. 

Probabilities : Empirically  generated  probabilities  of 

conflict  and  crisis  are  a key  feature  of  EWAMS.  A 
decision-analytic  model  featuring  probabilities  would 
greatly  facilitate  comparative  testing,  evaluation,  and 
blending  of  empirically  and  subjectively-generated 
probabilities  and  the  indicators  and  data  underlying 
them. 

Thresholds : Much  more  research  needs  to  be  and  will  be 

done  on  the  establishment  of  warning  thresholds  and  hit 
and  false  alarm  rates  for  empirical  indicators.  Decision- 
analytic  models  with  the  capacity  to  determine  thresholds 
and  to  evaluate  hit  and  false  alarm  rates  will  facilitate 
such  research  and  development. 

Flexibility : This  is  a catch-all  category  covering 

considerations  of  model  logic,  user  ease,  and  the  com- 
patibilities of  model  computer  bases. 

Input  Data:  How  much  theoretical  surgery  must  be 
performed  on  decision-analytic  models  to  allow  direct 
input  of  empirical  data  rather  than  just  analyst 
assessment  of  it? 


6.3  Potential 


It  is  possible  to  integrate,  at  least  conceptually, 
decision-analytic  models,  Bayesian  Hierarchical  Inference 
(BHI)  ones,  and  empirical  ones. 

Such  integration  can  be  approached  in  a variety  of 
ways.  One  possibility  is  to  have  empirical  indicators  and 
probabilities  feed  a BHI  model  which  in  turn  would  feed  a 
decision-analytic  option  selection  and  evaluation  model.  In 
this  instance,  the  output  from  the  Early  Warning  and  Moni- 
toring System  would  serve  both  as  long-range  predictors  to 
focus  a BHI  model  and  as  observable  data  for  that  model. 

The  BHI  model  would  in  turn  serve  as  input  to  probability 
assessment  of  uncertain  events  affecting  outcomes  in  the 
decision  analysis  model.  As  the  situation  to  which  the 
models  are  addressed  evolves  over  time,  the  evaluation  of 
options  would  consist  of  a comparison  of  changing  proba- 
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bilities  with  the  thresholds  established  by  the  decision 
rules  to  identify  points  in  the  dynamic  situation  at  which 
the  expected  value  of  options  might  change.  Figure  6-1 
outlines  this  general  scheme  as  applied  to  a Lebanon  evacu- 
ation . ^ 

Another  possibility  is  to  have  the  BHI  and  empirical 
models  run  in  parallel.  This  would  serve  a corraborating 
function  and  allow  the  decision  maker  to  choose  the  proba- 
bilities he  felt  most  suitable  to  specific  uncertain  events 
in  his  decision  model  (see  Figure  6-2). 

A third  possibility  reverses  this  linkage.  It  should 
be  possible,  conceptually  at  least,  for  a BHI  model  to  feed 
the  Early  Warning  and  Monitoring  System.  For  example,  a BHI 
model  of  long-range  Arab  strategy  toward  Israel  might  hypoth- 
esize peace,  limited  military  action,  and  risk  of  prolonged 
war.  The  hypotheses  would  refer  to  a relatively  long  time 
span,  and  the  model  would  include  general  political,  economic, 
and  military  indicators.*’  Thresholds  for  the  transition 
from  peace  to  one  of  the  other  hypotheses  might  be  established 
subjectively,  through  retrospective  analysis,  or  by  use  of 
the  model  over  time.  If  the  established  probability  thresh- 
old were  crossed,  the  analyst  would  then  activate  the  Early 
Warning  and  Monitoring  System  and  fo^us  on  the  relevant 
countries  or  country  pairs.  Thresholds  could  in  turn  be  set 
for  the  Early  Warning  System  indicators  and  probabilities, 
j Crossing  of  these  thresholds  might  be  used  as  a signal  to 

activate  a BHI  short-range  Military  Posture  Model  to  be  used 
in  conjunction  with  the  empirical  model. 

I The  intelligence  component  of  other  decision  analytic 

models  could  also  be  used  to  feed  the  empirical  system. 

4 

Details  of  this  linkage  can  be  found  in  Decisions 
and  Designs,  Incorporated  (1977b). 

^For  an  example  of  BHI  models  of  North  Korean  long-  and 
short-range  strategies  and  their  linkages,  see  Stewart  et  al . (1976). 
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Figure  6 1 

LINKAGE  OF  EMPIRICAL,  BMI,  AND  OPTION  SELECTION  MODELS  - 


Figure  6 2 

LINKAGE  OF  EMPIRICAL,  BMI,  AND  OPTION  SELECTION  MODELS 


With  logic  similar  to  that  above,  thresholds  could  be  estab- 
lished for  event  likelihoods.  Changes  in  these  subjectively 
generated  event  likelihoods  could  be  used  to  trigger  the 
empirical  system. 

A final  vehicle  for  the  blend  is  less  comprehensive 
than  the  possibilities  discussed  above,  but  can  be  imple- 
mented and  tested  more  quickly.  If  the  analyst  using  the 
Early  Warning  and  Monitoring  System  wishes  to  examine  the 
actual  events  on  which  its  probabilities,  indicators,  and 
numbers  are  based,  he  can  call  up  a narrative  description  of 
those  events.  The  verbal  descriptions  could  serve  as  a 
supplement  to  his  expertise  and  as  an  input  to  alter  the 
empirical  probabilities  generated  by  the  system.  The  analyst 
would  alter  the  probabilities  by  relying  on  what  he  reads 
and  on  his  expertise  rather  than  by  accepting  what  the 
indicators  and  probabilities  aggregated  from  these  events 
tell  him.  The  Early  Warning  and  Monitoring  System  would 
thus  have  an  option  for  subjective  control  of  its  own  esti- 
mates and  would  also  provide  part  of  the  input  to  control  by 
the  expert. 

As  with  most  endeavors,  it  is  likely  that  the  blend  of 
the  empirical  I&W  system  with  decision-analytic  models  will 
be  rather  more  difficult  to  accomplish  in  practice  than  to 
describe.  Difficulties  will  be  the  result  not  only  of 
differences  in  logic  and  concept  but  of  the  distinctive 
computer  bases  of  the  two  methodologies. 

While  diverse  decision-analytic  models  can  be  evaluated 
in  terms  of  product,  dynamicism,  probabilities,  thresholds, 
flexibility,  and  input  data,  none  has  been  designated  as  the 
"best"  vehicle  for  the  blend.  Each  has  features  which  would 
make  it  amenable  to  a blend;  each  has  weaknesses  which  would 
constrain  integration.  Given  that  one  of  the  purposes  of 

See  Andriole  (1976b)  for  the  origin  of  this  idea. 


the  blend  is  to  provide  the  potential  users  in  the  I&W 
community  with  an  efficient  and  flexible  amalgam  of  the 
features  of  two  distinct  but  complementary  methodologies, 
perhaps  the  choice  of  vehicles  should  be  left  to  them.  They 
are  the  best  judge  of  the  form(s)  of  the  blend  which  would 
meet  their  needs.  The  role  of  those  researching  and  developing 
the  blend  would  then  be  to  provide  users  with  alternatives 
and  to  help  them  to  tailor  their  choices  to  their  specific 
needs.  Whatever  their  choice,  some  integration  of  empirical 
and  subjective  methodologies  for  I&W  (and  potentially  opera- 
tions) will  provide  users  with  a more  effective  tool  than 
independent  application  of  the  methodologies. 


7 . 0 FUTURE  RESEARCH 


There  are  three  complementary  yet  separable  paths  which 
future  research  with  the  Early  Warning  and  Monitoring  System 
will  or  can  take.  These  are:  (1)  implementation  of  EWAMS 
design,  (2)  "Intelligent"  IS.W,  and  (3)  an  I&W/Operations 
link. 

7.1  Implementation  of  the  Earlv  Warning  and  Monitoring 


System  Design 


The  future  research  path  that  will  be  pursued  most 
rigorously  and  intensively  is  development,  testing,  and 
implementation  of  the  system  design  illustrated  in  Figure  7-1 
Development  of  each  of  the  three  systems  comprehended 
by  EWAMS--information  retrieval,  warning,  and  monitoring — 
will  continue.  Development,  testing,  and  evaluation  of  the 
components 

o general  scans, 

o quantitative  political,  military,  economic,  and 

domestic  indicators, 

o forecasting  methods,  and 

o computer  base 

is  on-going  and  will  continue.  The  methodological  and 
bureaucratic  strategy  outlined  in  Section  3.0  for  making  the 
transition  from  a monitoring  to  a warning  system  will  be 
pursued. 
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7.2  "Intelligent  I&W" 


The  obstacle  to  implementation  of  this  component  of 
EWAMS  design  is  not  bureaucratic;  it  is  the  very  large 
amounts  of  time,  money,  effort,  hardware,  etc.  required. 
"Intelligent  I&W"  is  the  rubric  for  a number  of  complex  and 
diverse  enhancements  that  should  be  made  to  EWAMS  to  in- 
crease its  efficiency  and  utility  to  the  I&W  community. 
"Intelligent  I&W,"  which  may  at  present  resemble  a "wish 
list"  more  than  a concept,  may  be  broken  into  intranational 
and  international  arenas.  Figure  7-2  suggests  components  of 
the  former  and  Figure  7-3  the  latter,  while  Figures  7-4 
and  7-5  show  what  output  for  each  might  resemble. 

"Intelligent  I&W"  is  the  logical  extension  of  the  EWAMS 
design.  While  it  may  seem  like  a list  of  enhancements 
rather  than  a new  concept,  it  is  evident  that  development, 
testing,  and  implementation  of  the  Intelligent  I&W  idea 
will  require  large  amounts  of  manpower  and  money  for  design 
and  programming.  However,  the  payoff  in  terms  of  improved 
analyst  efficiency  and  performance  would  seem  to  justify  the 
cost. 


7 . 3 I&W/Operations  Link 

Given  contractual  guidelines  and  bureaucratic  politics, 
future  research  on  linking  I&W  and  operations  activities — 
or  more  specifically,  crisis  warning  and  management — must 
remain  in  the  realm  of  the  possible.  However,  the  existence 
of  the  hardware-compatible  EWAMS  and  an  Executive  Aid  for 
Crisis  Management  (CACI  1977)  as  well  as  the  conceptual 
linkage  sketched  below,  offer  at  least  a partial  foundation 
for  any  future  research. 

7.3.1  Establish  requirements  of  a crisis  warning  and 
management  system.  Arguments  about  the  relative  utility  of 


ALERT  LIST  = AUTOMATIC 

• Tracking  of  countries  for  which  system  indicators 
have  crossed  warning  thresholds 

• Identification  of  characteristics  of  disturbance,  EG, 
source,  military,  political,  economic  issue  area  - 
target;  form 

• Calculation  of  probability  that  domestic  conflict 
will  expand 

SEARCH  FOR  SIMILAR  HISTORICAL  PATTERNS 

• EG,  a domestic  tension  > 70  for  Poland,  sparked 
by  food  riots,  can  trigger  output  for  magnitude, 
intensity,  duration  and  outcome  of  previous  food 
riots 

ANALYSIS  OF  POTENTIAL  EVOLUTION  OF 
DISTURBANCE  = AUTOSCAN  FOR 

• Contagion  possibilities 

• Magnitude 

• Intensity 

• Forms 

• Targets 

MAINTAIN  COUNTRY  PROFILES 

• Decision-maker  characteristics  and  values, 
government  instability  and  societal  unrest 
indices,  economic  performance,  demographic 
characteristics 

RECOMMEND  COLLECTION  PRIORITIES 

• Based  on  all  the  above,  flag  needed  changes  in 
collection  targets  and  methods  for  alert  list 
countries 


Figure  7-2 

COMPONENTS  OF  INTELLIGENT  l&W  (Domestic) 


I 

!■ 


• ALERT  LIST 

- AUTOMATIC  TRACKING  OF  WORLD,  REGIONS, 
COUNTRY  PAIRS  FOR  INDICATOR  THRESHOLD 
CROSSINGS 

• INDICATORS 

- AUTOMATIC  ACTIVATION  OF  MILITARY, 

ECONOMIC,  AND  INTRANATIOF'AL  INDICATORS 
FOR  ALERT  LISTINGS 

• HISTORICAL  PRECEDENT  SEARCH 

- E G.,  A USSR  CZECH  CRISIS  PROBABILITY  OF 
> 70  TODAY  WOULO  TRIGGER  OUTPUT  OF 
1968  INVASION 

• THREAT  NETWORKS 

- E.G.,  A NORTH/SOUTH  KOREAN  TENSION  LEVEL 
OF  80  WOULO  TRIGGER  EXAMINATION  OF  TENSION 
BETWEEN  US  AND  SOUTH  KOREA  AND  USSR  AND 
NORTH  KOREA 

• DATA  COLLECTION 

- SYSTEM  AUTOMATICALLY  SIGNALS  CHANGES  IN 
COLLECTION  PRIORITIES 


Figure  7-3 

''INTELLIGENT"  l&W  SYSTEM 
(International) 
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ttttf  EARLY  WARNING  AND  H0N1T0RINC  PROTOTYPE  SYSTEM  ACTIVATED  ttttt 

ALERT  LIST  (Domestic) 

31  January  1976 


1.  Italy 

2.  Iran 

3.  South  Africa 

4.  Nicaragua 

5.  Indonesia 
€.  Northern  Ireland 

A system  indicator  for  the  above  countries  crossed  the  warning 
threshold  at  9500  today.  Automatic  system  evaluation  indicates 
that  the  primary  charac  tcnstics  of  the  internal  disturbance  and 
the  probability  of  expanded  danger  in  these  countries  is  as 

foi t ows: 

I »aiy--Anti-govemment  demonstrations  by  left-wing  political 
groups  (.73) 

lron--Uiolent  clashes  between  pro  and  anti-Shah  groups  (.44) 
South  Africa — Scattered  anti-apartheid  terrorist  bombings  (.74) 
Nicaragua — Sporadic  riots  sparked  by  assassination  of 
opposition  newspaper  editor  (.59) 

Indonesia — Widespread  arrests  and  detention  of  student 
dissidents  (.42) 

Northern  Ir el and--Renewcd  bombing  of  protestant  targets  by 
IRA  nembers  <.59) 

The  system  will  continue  to  monitor  these  domestic  situations. 
Evaluations  will  be  updated  and  reported  as  new  information 
becomes  available. 


ALERT  LIST  (Domestic) 
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ttttt  EARLY  WARNING  AND  MONITORING  PROTOTYPE  SYSTEM  ACTIVATED  ttftt 

ALERT  LIST  ( International  Political) 

31  January  1978 


1.  Somal ia-Ethopia 

2.  Sonatia-USSR 

3.  Italy 

4.  Middle  East 

5.  Israel-Egypt 

6.  EFI 


The  above  countries?  country-pairs*  and  regions  crossed  the  warning 
threshold  of  a system  indicator  at  0398  today.  The  contagion  poten- 
tial of  the  above  danger  areas  has  been  automatically  analyzed  and 
can  now  be  repor ted.  Possible  contagion  networks  include! 


For  — 

1.  Eritrean  Liberation  Front 

2.  USSR-USA,  Cuba-USA 

3.  ltaly-USA*  Francc-Italy 

4.  ROZ  for  alt  region  members 

5.  USA-Israel*  USA- Jordan*  Jorda n- I sr ac 1 • Jordan-UAR 


Do  you  want  to  examine  other  contagion  possibilities?  (f 


Figure  7-5 

ALERT  LIST  (International) 
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crisis  warning  and  crisis  management  studies  are  a misuse  of 
scarce  resources.  The  two  are  so  related  that  advances  in 
one  benefit  the  other:  adequate  early  warning  facilitates 
planning  for  and  managing  of  crises;  good  management  informs 
and  directs  early  warning.  One  of  the  many  ways  in  which 
warning  and  management  systems  can  supplement  each  other  is 
illustrated  above.  Warnings  can  be  generated  from  quanti- 
tative indicators  or  from  BHI  techniques.  The  probabilities 
and  utilities  generated  from  either  or  both  can  feed  into  an 
interactive  computerized  crisis  management  system.  This 
system  can  be  based  on  empirical  or  qualitative  methodologies 
for  the  selection  and  evaluation  of  crisis  management  options. 
Ideally,  the  crisis  management  system  (as  well  as  the  early 
warning  system)  would  be  comprised  of  a blend  of  subjective 
and  objective  techniques. 

Another  way  in  which  crisis  warning  and  manage- 
ment are  related  is  through  the  concept  of  national  interests. 
As  discussed  in  Section  3.3.3,  quantified  interest  indicators 
can  be  used  in  early  warning  to  narrow  and  specify  the 
analyst's  scans  for  crises.  They  can  be  used  in  crisis 
management  to  examine  the  utilities  of  the  U.S.,  allies,  or 
adversaries  involved  in  the  crisis.  The  link  between  fore- 
casting and  management  provided  by  a quantified  national 
interest  concept  is  indicated  in  Figure  7-6. 

Delineation  of  a country's  interests  is  of 
little  use  for  planning  and  crisis  management  unless  it  is 
supplemented  by  an  estimate  of  associated  risk  and  potential 
loss  to  those  interests.  Such  an  estimate  would  also  enhance 
forecasting  capabilities  by  allowing  the  analyst  to  further 
specify  his  scan.  An  assessment  of  associated  risks  and 
potential  costs  resulting  from  developing  crisis  could  be 
done  with  either  objective  or  subjective  techniques — or 
both.  Furthermore,  an  assessment  could  be  done  for  just  the 
U.S.,  the  U.S.  and  its  allies,  or  all  possible  participants 
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-►Crisis  Forecasting 


• Change  slowly  over  time 

• Allow  planning  for  crises 


t 


Allow  tracking  of  the 
national  interests  of 
potential  participants 


Utilities  for  US  national 
interest  in  crisis  (risk, 
and  loss  to  national  interests 
generated  by  both  subjective 
and  objective  means) 


US 

National 

Interests 


I 


Crisis  Management/ 
Decision-making 


Figure  7-6 

THE  NATIONAL  INTEREST  LINK 

j BETWEEN  CRISIS  EARLY  WARNING  AND  MANAGEMENT 


including  adversaries.  A national  interest  assessment  for 
all  possible  participants  would  be  of  great  use  to  U.S. 
planners  and  crisis  managers.  Knowledge  of  the  risks  and 
potential  losses  associated  with  specific  national  interests 
of  all  participants  would  be  very  useful  for  U.S.  participants 
in  crisis  bargaining  and  negotiations,  as  would  an  algorithm 
for  optimizing  U.S.  interests  and  utilities  in  different 
types  of  crises. 


i 


Categorization  of  national  interests  according 
to  their  military,  political,  or  economic  nature  will  also 
be  useful  to  various  types  of  users.  Interests  not  only 
differ  substantively,  but  also  in  terms  of  the  concern  with 
which  they  are  viewed  by  various  levels  in  different  agencies. 
For  example,  on  the  global  level  DoD  has  an  immediate  as 
well  as  a long-term  concern  with  military  national  interests. 
National  level  commands  also  have  a concern  with  long- 
term political  and  economic  interests  as  they  potentially 
impinge  on  military  interests.  The  concern  of  theatre  level 
commands  is  less  comprehensive  in  terms  of  both  substantive 
interests  and  time.  Other  agencies  concerned  with  crisis 
early  warning  would  place  different  priorities  on  national 
interests.  For  example,  the  Department  of  State  would  be 
more  concerned  with  the  economic  and  political  national 
interests  of  participants  in  a potential  crisis  than  with 
military  interests.  The  inclusion  of  indicators  of  several 
types  of  national  interests  in  the  third-stage  prototype 
system  will  broaden  its  appeal  to  potential  users. 

Midway  between  warning  and  management  is  con- 
tingency planning  for  crises.  As  several  quantitative 
studies,  e.g.,  Breemer  (1974),  Martin  (1977a),  and  the 
Threat  Recognition  and  Analysis  Project  (McClelland,  McGowan, 
and  Martin  1976)  have  demonstrated,  national  interests 
change  relatively  slowly  over  time.  Thus  once  current 
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interests,  whether  military,  political,  economic,  or  cul- 
tural, are  delineated,  to  a certain  extent  contingency  plans 
can  be  based  on  them. 


Delineation  of  U.S.  national  interests  should 
provide  an  indication  of  the  countries  or  organizations  with 
which  the  U.S.  is  likely  to  become  involved  in  a crisis. 

This  is  a part  of  the  warning  function  national  interest 
indicators  can  provide.  It  also  suggests  that  the  national 
interests  of  those  countries  and  organizations  should  be 
monitored.  This  would  give  U.S.  planners  a jump  on  assessing 
potential  risks  and  losses  to  our  own  as  well  as  adversary 
national  interests  in  a future  crisis.  It  would  thus  facilitate 
the  planning  of  bargaining  and  negotiation  strategies. 

A fully  integrated  crisis  warning  system  would 
be  user-oriented,  computer-based,  and  be  comprised  of  both 
subjective  and  objective  methods  for  crisis  early  warning 
and  management.  In  addition  to  the  link  provided  by  quan- 
titative indicators  of  national  interests,  warning  and 
management  capabilities  would  be  integrated  by  the  extension 
of  the  blend  between  empirical  and  decision-analytic  tech- 
niques for  early  warning  to  be  developed  in  the  third-stage 
early  warning  system. 

In  addition  to  a synthesis  of  methodologies,  the 
early  warning  blend  will  require  conversion  and  integration 
of  currently  operationally  separate  hardware  and  software. 

If  this  can  be  accomplished,  development  of  a fully  inte- 
grated warning/management  system  will  be  greatly  facilitated. 

In  short,  in  addition  to  conceptual  and  methodological 
requirements,  a crisis  warning  and  management  system  would 
require  conversion  of  capabilities  of  the  IBM  5100,  on  which 
subjective  techniques  for  early  warning  and  management  are 
now  dependent,  to  the  PDF  11/70  and  Tektronics  4051  graphics 
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terminal  configuration  on  which  objective  techniques  for 
warning  and  management  are  dependent. 

7.3.2  Evaluate  warning  and  management  goals  and  methods. 
The  ultimate  goal  of  extant  computerized  warning  and  manage- 
ment systems  is  the  same--to  enhance  U.S.  security.  The 
differences  between  empirical  and  subjective  methods  for 
early  warning  described  above  are  also  found  in  computer 
based  systems  for  crisis  management.  As  illustrated  by  the 
Korean  and  Lebanon  evacuation  models  described  above,  crisis 
management  can  be  addressed  by  subjective  techniques.  As 

the  computer-based  executive  aid  developed  by  another  Crisis 
Management  Program  contractor  (CACI  1977)  illustrates, 
crisis  management  problems  can  also  be  addressed  with  em- 
pirically based  techniques. 

If  the  blend  between  subjective  and  empirical  in- 
dicators, probabilities  and  utilities  now  being  tested 
demonstrates  that  the  methodologies  are  complimentary  and 
synergistic,  the  same  blend  should  be  evaluated  for  crisis 
management.  This  testing  and  evaluation  should,  of  course, 
be  preceded  by  rigorous  and  separate  testing  and  evaluation 
of  the  two  techniques  for  crisis  management  in  themselves. 

7.3.3  Examine  computer  capability  for  interactive  crisis 
warning  and  management  system.  In  parallel  with  the  above 
explorations,  examination  of  ways  to  integrate  separate 
hardware  and  software  configurations  must  be  examined. 

Given  the  goal  of  a fully  integrated  crisis  early  warning 
and  management  system,  which  would  require  large  computer 
capacity,  it  is  likely  that  IBM  5100-based  techniques  will 
have  to  be  converted  to  PDP  ll/70~based  technology.  In 
addition  to  its  probable  necessity,  such  a conversion  is 
also  desirable  because  of  the  graphics  capability  of  the 
11/70  and  the  4051. 


162 


T* 


Some  views  on  the  relationship  between  warning/moni- 
toring and  action/decision  contend  that  a warning  must  not 
merely  be  given,  but  be  acted  on  to  be  a success.  Henry 
Kissinger  has  been  quoted  as  saying,  "A  warning  is  not  a 
warning  until  it  reaches  me."  This  can  serve  as  a summary 
statement  of  a variety  of  problems  that  arise  with  the 
attempt  to  connect  warning  to  action,  whether  operationally 
or  conceptually.  There  are  at  least  five  operational  reasons 
why  a warning  may  never  be  connected  to  an  action: 

1.  the  event  was  unknowable,  i.e.,  lacked  even 
theoretically  perceivable  precursors; 

2.  critical  gaps  in  available  information; 

3.  communication  inadequacies; 

4.  consumer  failures;  and 

5.  analyst  failures."^ 

To  an  extent,  the  Early  Warning  and  Monitoring  System  can 
ameliorate  all  these  problems  except  the  first  one.  For 
example,  if  the  system  were  installed  in  more  than  one  I&W 
center,  its  output  could  provide  a standard  language  for 
communication.  As  suggested  above,  system  indicators  might 
also  mitigate  analyst  failures  by  playing  a devil's  advocate 
role. 


Conceptually,  it  is  possible  to  go  even  further  with 
the  warning-action  link  by  designing  an  integration  of 
computer-based  warning  and  crisis  management  systems  such  as 
illustrated  in  Figure  7-1.  However,  such  conceptual  designs 
are  likely  to  run  into  bureaucratic  brick  walls.  Perhaps  if 
it  can  eventually  be  demonstrated  that  the  Early  Warning  and 
Monitoring  System  can  contribute  (in  a narrow,  ad  hoc  manner) 
to  an  operational  linking  of  warning  and  action,  prototypes 
representing  more  ambitious  conceptual  links  could  be  gradually 

For  elaboration  of  these  reasons,  see  Shryock  (1977a, 
1977b,  and  1977c) . 
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mttmu  EARLY  WARNING  AND  MONITOR  I NC  SYSTEM  Ittltnitt 


The  Eorly  Warning  and  Monitoring  System  was  originally 
developed  for  the  Defense  Advanced  Research  Projects  Agency's 
Cybernetics  Technology  Office  (ARPA-'CTO)  by  Decisions  and 
Designs,  Incorporated  (DD1)|  current  development  is  being 
performed  by  the  International  Public  Policy  Research 
Corporation  <IPPRC>. 

This  version  of  the  system  shows  how  a computer-based 
warning  system  comprised  of  quantitative  political  indicators 
might  be  used  by  intelligence  analysts  in  ’real-time*  to  moni- 
tor international  affairs  and  forecast  international  crises. 

The  analyst  can  use  the  system  to  track  single  countries. 
country-pairSf  JCS  regions)  regions  of  his  own  creation,  or  the 
entire  international  system.  The  system  includes  data  from  1?£6 
to  the  present  so  that  the  analyst  can  do  historical  analyses  if 
he  so  desires. 

Future  versions  of  the  system  will  add  quantitative  mili- 
tary and  economic  indicators  to  the  political  ones  to  give  the 
analyst  a multi-track  indicator  system  for  early  warning  and 
moni tor ing. 

tltttttttutttttlliutttttttttlt 


Please  press  RETURN  to  activate  the  system: 


L66 


***  EARLY  UARN1NC  AMD  MONITORING  SYSTEM  ACTIVATED  »** 


Are  your  ac  tor*: 
t.  Countries 

2.  JCS  regions 

3.  Both  1 

Please  select  two  countries(usarusr):  use, war 

Specify  activity  flow: 

8.  one  way  <usa  >>>  war) 

1.  one  way  fuse  <((  war) 

2.  two  way  (usa  <->  war)  2 

Select  tine  increment: 

1.  nonthly 

2.  Quarterly 

3.  yearly  1 

Set  tine  paraneters(7501-7712>:  7701-7803 


tXXXXtXtXtttX  8.  Warsaw  Pact  llliumttll 


albania 

bulgaria 

Czechoslovakia 

yernany/den  rep 

hungary 

pol and 

runania 

ussr 


(alb) 
(bu  I ) 
(cze> 
<g«e/ 
(hun) 
(pol  ) 
(run) 
(usr  ) 


ttxtxttxtxttxttxtxtxxxtxxxxxxxttxtxtxxtxxti 


Press  RETl/RN  to  continue: 
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PROCESSING 

COMPLETED 


Number  of  events  found:  726 

Oo  you  desire  36  day  probablistic  f orec as tsfy^n):  y 


Monthly  Probability 
Jan,  1977  - May,  1978 

ttt  usa  <<<>>>  war  MS 

Ootc  Probability 

Jan  77  .16 

Feb  77  .16 

Mar  77  .23 

Apr  77  .48 

May  77  .16 

Jun  77  .23 

Jul  77  .18 

Aug  77  . 18 

Sep  77  .16 

Oct  77  .18 

Nov  77  .16 

Dec  77  .16 

Jan  76  .16 

Feb  78  .23 

Mar  78  .16 

Apr  78  .18 

May  76  .48 


Press  RETURN  to  continue: 


SYSTEM  OPTIONS  ! 


tables 
plots 
text 
PCS  I 
end 


(tabular  output) 
(praphical  output) 
(textual  output) 

(chanpc  input  parameters) 
(terminate  execution) 


Any  of  these  commands  typed  after  the  *%•  wilt 
cousc  execution  of  the  chosen  function. 


■<  plots 


Total 


Conflict  iTension 


Unc  er  t 


Activity  lActivity  Activity  Level 


Paw  Data 


Z-Score 


Do  you  want  more  than  one  plot  per  praph  (y  or  nsy 
You  have  these  choices: 

1 ■ praphs  Id  4 J 

2 • praphs  2|4  ♦ C 

3 ■ praphs  7 ♦ 9 


Please 


I • pr  i 
pick  i 


Uk 


Monthly  Activity 
Jon,  1977  - May,  1978 

ttt  usa  <<<<<<  Tvo-Uay  Flow  >>>>>>  war  »ti 


Total 

Ac  tivi ty 

Cooperative  Activity 

Conflictual  Activity 

Date 

number 

z-acorc 

prob 

number 

x-*core 

orob 

number 

z -sc ore  prob 

Jan  77 

21 

-8.37 

8.18 

11 

-8.52 

8.18 

18 

8.87 

8. 18 

Feb  77 

36 

8.46 

8.13 

23 

8.34 

8.15 

13 

8.44 

8. 18 

Mar  77 

67 

2.16 

8.48 

42 

1.78 

8.21 

25 

1.95 

8.23 

Apr  77 

63 

1.88 

8.16 

37 

1.32 

8.21 

26 

2.83 

8.42 

May  77 

29 

8.83 

8.13 

22 

8.23 

8.  IS 

7 

-8.34 

8.  18 

Jun  77 

49 

1.18 

8.16 

26 

8.52 

8.  IS 

23 

1.62 

8.23 

Jul  77 

33 

8.34 

8.13 

18 

-8.86 

8.18 

17 

8. 86 

0. 16 

Aut  77 

29 

8.81 

8.13 

21 

8.16 

8. 13 

8 

-8.24 

8.  18 

Sep  77 

38 

8. 38 

8.13 

31 

8.88 

8. 15 

7 

-8.36 

8.  18 

Oct  77 

38 

8.49 

8. 13 

23 

8.29 

8. 13 

15 

8.62 

9.  18 

Mov  77 

33 

8.22 

8.13 

27 

8.38 

8. 15 

6 

-8.49 

6. 18 

Dec  77 

43 

8.87 

8.13 

37 

1.31 

8.21 

8 

-8.24 

8.  18 

Jan  78 

29 

-8.81 

8. 18 

28 

8.86 

8. 15 

9 

-8. 12 

8.18 

Feb  78 

34 

8.27 

8.13 

16 

-8.23 

8.18 

18 

1.81 

8.23 

Mar  78 

42 

8.71 

8.13 

28 

8.63 

8.15 

14 

8. 58 

6.  16 

Apr  78 

66 

2.83 

8.48 

33 

2.62 

8.21 

11 

8.  12 

8.  18 

May  78 

74 

2.42 

8.48 

47 

1.96 

8.21 

27 

2.13 

8.4£ 

Fret*  PFTURN  to  continue: 


Monthly  Tentlon  and  Uncertainty 
Jan,  1977  - May,  1978 

ttt  uta  <<<<<<  Tvo-Uay  Flow  >>>>>>  war  »** 


Date 

Tension 

2-«core 

H-rel 

Z-*core 

Jan  77 

43.4 

8.71 

8.587 

8.11 

Feb  77 

35.1 

8.13 

8.625 

8.37 

Mar  77 

36.6 

8.24 

8.648 

8.53 

Apr  77 

48.6 

8.43 

8.585 

8.89 

May  77 

23.3 

-8.38 

8.488 

-8.68 

Jun  77 

46.8 

8.75 

8.498 

-8.53 

Jul  77 

47.2 

8.61 

8.594 

8.  16 

Au«  77 

26.6 

-8.33 

8.482 

-8.64 

Sep  77 

17.9 

-8.81 

8.312 

-8.43 

Oct  77 

38.4 

8.33 

8.393 

-1.28 

Mov  77 

17.6 

-8.83 

8.457 

-8.81 

Dec  77 

17.4 

-8.84 

8.438 

-8.99 

Jan  78 

38.8 

-8.13 

8.683 

8.27 

Feb  78 

31.4 

1.88 

8.515 

-8.38 

Mar  78 

32.5 

8.81 

8.533 

-9.24 

Apr  78 

16.4 

-8.98 

8.479 

-8.64 

May  78 

36.6 

8.21 

8.367 

8.82 

Do  you  want  avent  freauanc ict(y'n)' 


2 


r- 

Honthly  Cooperative  Activity 

Jan,  1977  - Hay,  1978 

*t«  uca  <<<<<<  Two-Way  Flow  >>>>>>  war  (t* 

1 

Da  te 

VLD 

CHNT 

CNSL 

APPR 

PRHS 

GRNT 

REND  ACRE 

ROST 

PPOP 

Jan 

77 

• 

7 

2 

1 

8 

8 

8 8 

8 

1 

Fab 

77 

• 

12 

8 

8 

1 

8 

8 8 

8 

2 

Hir 

77 

8 

22 

18 

8 

8 

1 

8 4 

2 

3 

Apr 

77 

1 

26 

8 

8 

8 

2 

8 8 

8 

8 

Haw 

77 

e 

13 

4 

8 

1 

8 

8 4 

8 

8 

Jun 

77 

e 

21 

4 

8 

8 

1 

8 8 

8 

e 

Jut 

77 

8 

18 

S 

1 

8 

8 

8 8 

1 

1 

Aug 

77 

8 

14 

s 

1 

8 

1 

8 8 

8 

8 

Sap 

77 

8 

17 

18 

8 

1 

1 

8 2 

0 

8 

Oct 

77 

8 

19 

2 

2 

8 

8 

8 8 

8 

8 

How 

77 

8 

18 

7 

2 

8 

8 

8 8 

8 

2 

Dec 

77 

8 

24 

18 

1 

8 

8 

8 8 

8 

2 

Jan 

78 

8 

18 

4 

1 

8 

1 

8 2 

1 

1 

Feb 

78 

8 

13 

2 

8 

8 

8 

8 8 

1 

8 

Har 

78 

8 

28 

2 

8 

8 

8 

8 3 

3 

0 

Apr 

78 

8 

37 

18 

2 

8 

2 

8 2 

1 

1 

Hay  78 

Frees  RETURN  to 

8 38 

continue: 

18 

8 

8 

1 

8 4 

1 

1 

^ 

r 

Honthly  Confllctua)  Activity 

Jan,  1977  > Hay,  1978 

usa  <<<<<<  Two-Hoy  Flow  >>>>>>  war 

**» 

Date 

RJCT 

ACUS 

PROT 

DENY 

DHND 

UARN  THRT 

DEHO 

P.DUC 

EXPl 

SE 12 

FRCE 

Jon  77 

8 

3 

1 

2 

8 

2 

8 

8 

8 

8 

8 

0 

Feb  77 

8 

4 

2 

3 

8 

1 

8 

8 

8 

2 

1 

8 

Hor  77 

8 

14 

2 

3 

1 

8 

3 

8 

2 

8 

8 

8 

Apr  77 

3 

11 

3 

3 

8 

8 

5 

8 

8 

8 

1 

8 

Hoy  77 

8 

3 

8 

8 

2 

8 

8 

8 

8 

8 

8 

8 

Jun  77 

1 

16 

1 

1 

1 

1 

8 

8 

8 

8 

2 

8 

Jul  77 

1 

11 

2 

8 

8 

2 

8 

8 

1 

8 

8 

8 

Aug  77 

1 

5 

8 

8 

8 

8 

8 

8 

2 

8 

8 

8 

Sep  77 

8 

4 

8 

1 

8 

1 

8 

1 

8 

8 

8 

8 

Oct  77 

8 

13 

1 

1 

8 

8 

8 

8 

e 

8 

8 

8 

Nov  77 

8 

5 

8 

8 

8 

1 

8 

8 

8 

8 

8 

Cl 

Dec  77 

1 

6 

8 

8 

8 

8 

1 

8 

8 

8 

8 

8 

Jan  78 

8 

7 

8 

1 

1 

8 

8 

8 

8 

8 

8 

8 

Feb  78 

8 

11 

8 

1 

8 

2 

3 

8 

1 

0 

8 

8 

Har  78 

1 

8 

8 

8 

8 

1 

3 

8 

8 

8 

1 

8 

Apr  78 

2 

8 

8 

8 

8 

8 

1 

8 

8 

8 

8 

8 

Hay  78  8 

Frets  RETURN  to 

18  8 

continue: 

2 

8 

1 

3 

8 

8 

2 

1 

8 

SYSTEM  OPTIONS  : 


tablci 

plot! 

text 

qcsl 

end 


(tabular  output) 
(graphical  output) 
(textual  output) 

(change  input  parameter!) 
(terminate  execution) 


Any  of  theae  commands  typed  after  the  *5<*  will 
cause  execution  of  the  chosen  function. 


'<  ae  si 


***  EARLY  WARNING  AND  MONITORING  SYSTEM  ACT1UATED  ttt 


Are  your  actors: 
I.  Countries 


1.  Countries 

2.  JCS  regions 

3.  Both  I 


Please  select  two  c ountr ies (usa. usr > : usr.nat 


Specify  activity  flow: 

0.  one  way  (usr  ))>  nat) 

1.  one  way  (usr  <(<  nat) 

2.  two  way  (usr  <->  nat) 


Select  time  increment: 

1.  monthly 

2.  quarterly 

3.  yearly 


Set  tii 


tter s (7501 -7712):  7701-7005 


■ 


f — ~ ~ 

mm  9. North  Atlantic 

Treaty  Or*.  tltttt 

bclsiun 

(tel) 

Canada 

<can> 

dcnnark 

(den) 

frence 

(frn) 

ternany'fcd  rep 

(**w) 

•recce 

Iceland 

<»rc) 

(ICC) 

Italy 

(ita) 

luxcnbur* 

(lux) 

i nether  lands 

(nth) 

norway 

( nor  > 

per tutal 

(por) 

turkey 

(tur) 

usa 

(usa) 

united  kinydon 

(unk) 

miimmummtmmmmmmmit 

Press  RETURH  to  continue: 

^ . 

PROCESSING 

COMPLETED 


Hunter  of  events  found:  7 77 

Do  you  desire  30  day  probabllstic  forecostsCy'n):  y 


ii ir  ■ ♦ north  attentic  treaty  or*. 

Confllctual  Activity 


Honthl 
Jan,  197; 


thly  Activity 
977  - Hay,  1978 


ttt  usr  ««<<  Tvo-Uay  Flow  >>>>>>  oat  tit 


Total 

Ac  tlvi ty 

Cooperative  Activity 

Conflictual  Activity 

Da  tc 

number 

z-score 

prob 

number 

z-score 

prob 

number 

Z-score  pre-b 

Jan  77 

26 

-8.34 

8.18 

11 

-8.71 

8. 18 

15 

8.43 

8.  IS 

Fab  77 

41 

8.36 

8.13 

29 

8.42 

8.15 

12 

8. 18 

e.  is 

Har  77 

68 

1.62 

8. 16 

39 

1.85 

8.21 

29 

1.95 

0.23 

Apr  77 

69 

1.64 

8. 16 

38 

8.98 

8. 15 

31 

2.12 

8.48 

Hoy  77 

32 

-8.18 

8.18 

23 

8.82 

8.15 

9 

-8.26 

8. 18 

Jun  77 

64 

1.39 

8.16 

41 

1.16 

8.21 

23 

1.23 

8.23 

Jul  77 

48 

8.26 

8.13 

24 

8.88 

8.15 

16 

8.47 

8. 18 

Au*  77 

38 

-8.28 

8. 18 

22 

-8.85 

8.18 

8 

-8.38 

8. 18 

Sep  77 

39 

8.22 

8.13 

31 

8.52 

8.15 

8 

-8.38 

8. 18 

Oct  77 

41 

8.31 

8.13 

27 

8.26 

8.15 

14 

8.26 

8. 1? 

Nov  77 

38 

-8.21 

8.18 

24 

8.87 

8. 15 

6 

-8.68 

8. 18 

Dec  77 

37 

8.12 

8.13 

29 

8.39 

8.15 

8 

-8.38 

8.18 

Jan  78 

23 

-8.54 

8.18 

14 

-8.58 

8. 18 

9 

-8.27 

8. 18 

Feb  78 

38 

8.17 

8.13 

19 

-8.25 

8.18 

19 

8.82 

8. 16 

Har  78 

42 

8.36 

8.13 

28 

8.33 

8.15 

14 

8.27 

8. 18 

Apr  78 

61 

1.27 

8.16 

49 

1.71 

8.21 

12 

8.85 

8.  If 

Hay  78 

96 

2.93 

8.48 

64 

2.65 

8.21 

32 

2.25 

8.48 

Press  RETURN  to  continual 


1 
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r ~ ' " 

Monthly  Tension  any  Uncertainty 

\ 

*88  us r 

Jan.  1977  - Hay.  1978 

«««  Two-May  Flow  >>>>>>  net  Ml 

Date 

Tension  2-scorc 

N-rel  2 

-score 

Jan  77 

33. 3 1.41 

B.S75 

8.65 

Feb  77 

26.6  -B.I7 

8.637 

8.49 

S Mar  77 

42. B B.  SI 

8.623 

8.28 

Apr  77 

44.3  8.74 

8.637 

8.32 

Hay  77 

27.2  -B.2S 

8.484 

-1.88 

Jun  77 

33.4  8.22 

8.529 

-8.68 

Jul  77 

39.8  B. 43 

8.576 

-8.19 

Aut  77 

25.8  -9.3G 

8.474 

-1.86 

Sep  77 

28.8  >8.78 

8.344 

-8.46 

Oct  77 

33.3  8.18 

8.456 

-1.22 

Nov  77 

19.3  -8.74 

8.439 

-1.18 

Dec  77 

21.8  -8.C3 

8.535 

-8.31 

Jon  78 

37.4  8. 36 

8.569 

-8.21 

Feb  79 

48.7  1.84 

8.523 

-8.61 

! Mor  79 

32.3  8.85 

8.347 

-8.39 

Apr  79 

19.3  -8.75 

8.438 

-1.36 

How  7B 

33.8  8.89 

8.524 

-8.59 

Do  you  wont  event  frequcnc  ies(ym>7  n 

ttt  EARLY  WARNING  AND  MONITORING  SYSTEM  ACTIVATED  *»* 


your  actors: 

1.  Countries 

2.  JCS  refions 

3.  Both  1 


Specify  activity  flow: 

B.  one  way  fuse  >>>  usr> 

1.  one  way  <uta  <<<  usr> 

2.  two  way  <usa  <->  usr>  2 

Select  tiftc  increment: 

1.  monthly 

2.  quarterly 

3.  yearly  I 


uioiuir 


Set  tine 


K7381-7712):  7781-7683 


178 


Monthly 
Jan,  1977 

Activity 
- May,  1979 

tit  «•« 

««<< 

Two-Way  7tov 

>>>>>> 

uar  XXX 

T»t«t 

Activity 

Cooperative  Activity 

Conflict**!  Activity 

o*t* 

nunbar 

X-*c or* 

prob  nunber 

S-acora 

prob 

number 

x-acor«  prob 

Jan 

77 

t» 

-8.31 

8.18 

It 

-8.37 

9.19 

9.15 

9 

-9.99 

0. 10 

Ftk 

77 

11 

9.48 

8.13 

23 

9.59 

9 

9. 98 

0.11 

Mar 

77 

i\ 

2.11 

8.48 

38 

!:«? 

$.21 

25 

2.19 

9.«2 

Apr 

77 

2.23 

8.40 

37 

9.21 

28 

2.2  5 

9.42 

Nay 

77 

29 

8.23 

8.13 

22 

9.47 

9.13 

7 

-9.25 

9.  19 

Jvn 

77 

48 

1.32 

8.18 

28 

9.79 

9.15 

22 

1.89 

9.23 

Jut 

77 

|4 

8.51 

Ml 

18 

9.14 

9.15 

18 

9.99 

9. 13 

Au» 

77 

29 

8.21 

21 

9.39 

9.15 

9 

-9.14 

9.19 

It* 

77 

27 

9.87 

8.13 

31 

1.17 

9.21 

8 

-9.49 

9.19 

Oct 

77 

IS 

8.53 

8.13 

23 

9.52 

9.15 

12 

9.39 

9. 19 

Nov 

77 

38 

8.2« 

8.13 

24 

9.89 

9.15 

8 

-9.49 

9.19 

0«c 

77 

32 

8.37 

8.13 

24 

9.89 

9.15 

9 

-8.14 

9.ie 

Jan 

7% 

21 

-8.27 

8.18 

12 

-8.37 

9.19 

9 

-9.91 

9.19 

r«b 

79 

33 

8.43 

8.13 

18 

-9.95 

9.19 

17 

1.94 

9.23 

Mar 

79 

39 

8.71 

8.13 

25 

9.89 

9.15 

14 

9.84 

0.18 

Apr 

79 

59 

1.91 

8.18 

48 

2.54 

9.21 

11 

9.24 

9. 10 

Nay 

79 

72 

2.87 

8.49 

48 

2.39 

9.21 

28 

2.22 

9. 48 

Prtti 

L. 

RCTURH  to 

continue! 

^ 

r — 

Monthly 

Tenaion  and  Uncertainty 

Jan,  1977  - Nay, 

1979 

•XX  uee 

<<<<<< 

Two-Way  Flow  >>>>>> 

uar  at* 

Oat* 

Tencion  2-acor* 

M-r*l  2 

-i c ore 

Jan 

77 

39.9 

9.39 

8.379 

#.21 

Feb 

77 

27.2 

-8.31 

8.378 

9. 19 

Mar 

77 

49.3 

9.49 

9.811 

9.44 

Apr 

77 

40.8 

9.42 

0.393 

9.23 

May 

77 

23.3 

-9.34 

9.499 

-8.44 

Jun 

77 

44.9 

9.88 

9.381 

-9.33 

Jul 

77 

43.7 

9.79 

9.899 

9.37 

Auf 

77 

28.8 

-9.37 

9.492 

-0.49 

8cp 

77 

13.9 

i -8.97 

9.393 

-9.32 

Oct 

77 

33.3 

> 9.92 

9.393 

-1.12 

Nov 

77 

19.3 

1 -8.77 

8.439 

-8.84 

Dec 

77 

24.2 

-8.49 

9.417 

-8.94 

Jan 

79 

40.9 

l 9.43 

8.497 

-9.33 

Feb 

79 

59.9 

8.97 

9.319 

-9.19 

Mar 

79 

33.9 

i 9.11 

8.31? 

-9.28 

Apr 

79 

19.3 

1 -9.94 

9.439 

-9.78 

May  79 

35.8 

9. 13 

9.342 

-9.91 

Do  you  want  event 

I 
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w 

r — ’’  11  ~ 1 ■ ~ 

SYSTEN  OPTIONS  t 

\ 

p 

tables  - (tabular  output) 

plots  - (araohical  output) 

text  * (textual  output) 

•csl  - (change  input  parameters) 

end  - (terminate  execution) 

Any  of  these  commands  typed  after  the  *km  will 
cause  execution  of  the  chosen  function. 

L 

k text 

b 

-- 

tututmmmt  Event  t»»h  tttttttuttitttttttt 
Cooperative  Event*: 


•1  Yield  (YLO) 

•2  Comment  (CNNT) 

•3  Consult  ( CNSL > 

94  Approve  (APPR) 

93  Fronts*  (PRAS) 

Conflictual  Events: 

II  Reject  f R JCT > 

I?  Accuse  (ACUS) 

13  Protest  (PROT) 

14  Den*  (DENY) 

13  Demand  (DHHPi 
1C  Warn  (WARN) 

Please  Specify  Event  Types: 


96  Grant  (CANT) 

92  Reward  <RCUt>> 

98  Air**  (ACRE  > 

99  Request  (POST) 
19  Propose  (PROP) 


12  Threat  (THPT ) 

19  Demonstrate  (DENO) 
19  Reduce  (RDUC) 

29  Expel  (EXPL  > 

21  Seise  «SEU> 

22  force  (FACE) 


1.  All  cooperative  events 

2.  All  conflictual  events 

3.  All  events 

4.  Combination  3 

Do  you  want  to  perform  a keyword  search  for  these  event  typei»YN\* 
M 

Enter  Keyword  expression  or  press  RETURN  for  help: 
arms  talks«salt 

Specify  dates  (CC81-C6R4):  2881-2883 
P*M  full*  . • press  RETURN  to  continue 
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tttMttttttMMttStSStttSttttttTEXTtSttttStZttttttltStMtllllSIlll  Mil 
•(tort  ........  uso. usr 

flow  ........  Ufa  <<<  two-way  flow  >>>  wtr 

tine  ptr«N(|«ri,  ...  7691-7005 

event  twee* til  events 

keyword  expression  . . AIMS  TALKS. SAIT 

ttttittttttittttttttttttttttttttttittttittttttttttittttitixttt in  imu 
76621 1 365121  2 • 

the  u «r  blones  the  Itch  of  progress  in  the  uso  - utr 
strategic  arms  talks  on  opposition 

in  c onpress . the  penteton  and  the  military  industrial 
conplcx  usr 

7663  3 2 2 3305  9 

use  prs  carter  says  that  the  stratesic  arm  talks  under 
way  in  geneva  have  taken  norc  tine  than  he  hod  expected  and 
that  *12  highly  technical  issues*  still  stand  in  the  way  of 
agreenent  between  the  uso  and  urr 

796419  2 25363  9 

use  sst  vonce  says  that  *i  think  the  negotiation  of  a 
salt  agreenent  is  central  to  the  security  of  the  usa 
end  soviet  union  and  the  peace  of  the  world  and  should 
be  negotiated  on  its  own  feet  and  we  will  do  thot*  usr 

7665  4 2 23365  9 

use  prs  carter  says  he  does  not  think  the  usa  and  the  soviet 
union  have  finally  agreed  on  an  overall  ceiling  for  missiles 
and  bombers  at  the  strategic  arm  talks  usr 


Page  full. 


ic  arms  talks  usr 
RETURN  to  continue 


»tssstttsttttttttsttts«ttttst*tTEXT*ystttsttt*y»f  tttttttttttitm »?  j * • 
•(tors  use i usr 

flow  ........  uso  <<<  two-way  flow  >>>  usr 

tine  parameters.  . . . 7801-7605 

event  types all  events 

keyword  expression  . . ARMS  TALKS. SALT 

mmmimmmmnttttimitmmmmumimmmtiutiiMi 
7eesi6  2 23365  9 

usa  dos  rep  ton  reston  says  regarding 

whether  the  usr  orlov  trial  would  hove  any  effect  on  the 
erns  talks  that  the  strategic  arms  Imitation  treaty  was 
designed  *to  enhance  the  security  of  the  citizens  of  the 
usa*  usr 

769*2?  2 23365  9 

according  to  usa  officials  national  security  adviser 
bneiinski  and  his  aides  gave  china  a detailed 
briefing  on  the  status  of  usr-usa  strategic  arms  talks  and 
explained  some  secret  white  house  memoranda  on  uso  security 
goals  chn  usr 


N.*7  n 


f-o  you  want  to  perform  another  keyword  search  for  the  event  twpe-c' 
Do  you  want  to  look  at  more  text  CV/M>?  n 


S«t  EARLY  WARNING  AND  H0NIT0R1NC  SYSTEH  ACTIVATED  til 


Are  your  actors: 
t.  Countries 

2.  JCS  rations 

3.  Both  1 

Please  select  two  countries(usaiusr):  usr.chn 

Sore i fy  activity  flow: 

B.  one  way  <usr  >>>  chn> 

1.  one  way  (usr  <<<  chn) 

2.  two  way  (usr  <->  chn)  2 

Select  tine  increncnt: 

1.  Monthly 

2.  Quarterly 

3.  yearly  1 


Set  tii 


1(7501-7712):  7701-7885 


PROCESSING 

CONPLETED 


Nunber  of  events  found!  G4 
Do  you  desire  38  day  probablistic  forecos ts'y'n>:  y 


r 

Monthly 

Frobabi 1 i ty 

Jen,  1977  - Nay.  1979 

«t« 

utr 

<<<>>>  chn  tit 

Date 

Frobabi 1 i ty 

Jan 

77 

.18 

Feb 

77 

.18 

Mar 

77 

.18 

Apr 

77 

.18 

May 

77 

.18 

Jun 

77 

.18 

Ju) 

77 

.18 

Auf 

77 

.18 

Sep 

77 

.18 

Oct 

77 

.18 

Nov 

77 

.18 

Dec 

77 

.18 

Jan 

78 

. 18 

Feb 

78 

. 18 

Mar 

78 

.18 

Apr 

78 

.18 

Hay 

78 

.23 

Frets  RETURN  to  continue: 



it tr  » china*  people*  rep 

Conftictuol  Activity 


Honthly  Activity 
Jon*  1977  - Hay t 1978 


ttt  u*r  <<<<<<  Two-May  How  >>>>>>  ebn  lit 


Data 

Total 

■number 

Ac  tivi ty 
x-»cora 

prob 

Cooperative  Activity 
nunber  x-»core  prob 

ConFlictud  Activity 
nunber  x-*cor«  prob 

Jan 

77 

1 

-8.88 

8. 18 

8 

-8.68 

8.18 

1 

-8.48 

8.10 

Feb 

77 

1 

-8.59 

8. 18 

8 

-8.68 

8.  18 

1 

-8.46 

6.  10 

Har 

77 

8 

8.85 

8.13 

3 

8.79 

8.  15 

3 

-0.  19 

8.  10 

Apr 

77 

2 

-8.47 

8. 18 

8 

-8.68 

8.  18 

2 

-8.33 

8.  10 

Hay 

77 

4 

-8.21 

8. 18 

8 

-8.68 

8.  18 

4 

-8.04 

0.  18 

Jan 

77 

1 

-8.59 

8. 18 

8 

-8.68 

8.  18 

1 

-0.47 

8.  18 

Jul 

77 

3 

-8.33 

8. 18 

2 

8.34 

8. 15 

1 

-0.47 

8.  18 

Au* 

77 

5 

-8.87 

8. 18 

3 

8.81 

8.15 

2 

-0.32 

0.  18 

Sep 

77 

4 

-8.28 

8. 18 

8 

-0.61 

8. 10 

4 

-8.83 

0.  10 

Oct 

77 

5 

-8.87 

8. 18 

2 

8.34 

8. 15 

3 

-0.18 

8.  18 

Nov 

77 

2 

-8.48 

8.18 

2 

8.34 

8.  15 

8 

-8.62 

8.10 

Dec 

77 

2 

-8.48 

8. 18 

1 

-8.  14 

8. 18 

1 

-8.46 

0.  18 

Jan 

78 

• 

-8.72 

8.18 

8 

-8.62 

8. 18 

8 

-8.61 

8.  18 

Feb 

78 

2 

-8.45 

8.18 

8 

-8.61 

8. 18 

2 

-8.31 

8.  18 

Har 

78 

« 

8.89 

8.13 

3 

8.83 

8. 15 

3 

-8. 16 

8.  10 

Apr 

78 

6 

8.89 

8.13 

3 

8.83 

8. 15 

3 

-8.  16 

8.  16 

Hay 

78 

14 

1.17 

8. 1C 

3 

8.82 

8. 15 

11 

1.04 

8.2? 

Praia  BE  TUSH  to  continual 
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. 


t 


Monthly  Tension  and  Uncertainty 

Jan(  1977  - Nay*  1978 

tit  usr 

<<<<<<  Two-Way  Flow  >>>>>> 

chn  »tt 

Data 

Tension  2 

-score 

M-rel  Z 

-score 

Jan 

77 

28.6 

-6.64 

6.668 

-6.92 

Feb 

77 

28.6 

-8.64 

6.888 

-6.91 

Par 

77 

41.7 

-6.15 

6.224 

6.26 

Apr 

77 

58.8 

8.15 

6.888 

-6.91 

Hay 

77 

75.6 

1.84 

8.888 

-8.98 

Jun 

77 

28.8 

-8.65 

6.688 

-6.89 

Jul 

77 

22.2 

-6.85 

8.286 

6.19 

Aufl 

77 

32.8 

-8.49 

6.341 

8.98 

Sen 

77 

75.6 

1.66 

6.336 

8.67 

Oct 

77 

48.6 

8. 88 

8.218 

6.24 

Nov 

77 

6.8 

-1.66 

8.224 

6.27 

Dec 

77 

25.8 

-8.73 

8.224 

6.27 

Jan 

78 

8.8 

-1.62 

6.888 

-8.93 

Feb 

78 

58.8 

6.18 

6.888 

-6.92 

Nor 

78 

41.7 

-6.12 

6.327 

6.63 

Apr 

76 

41.7 

-8.12 

6.436 

1.37 

Nay 

Oo  you  want  event 

L 

78  73.6  1.61 

freaucnc iesty'nlt  n 

6.636 

2.42 

J 

Xttttttttt  TEXT 


Event  Types 

Cooperative  Events: 

61  Yield  (YLD> 

62  Consent  (CHNT) 

83  Consult  (CNSL> 

84  Approve  <APPR> 
83  Promise  <PRHS> 

Conflictual  Events: 
H Reject  <RJCT> 

12  Accuse  (ACUS) 

13  Protest  <PR0T> 

14  Deny  (DENY) 

15  Demand  (DHND) 

16  Warn  (WARN) 


66  Grant  <GRNT> 

87  Reward  (REND) 
68  Aprec  (ACRE) 

89  Reauest  (ROST) 
16  Propose  <PR0P> 


17  Threat  <TMRT > 

18  Demonstrate  (DEMO) 

19  Reduce  (RDUC) 

28  Expel  (EKPL) 

21  Seize  tSEIZ) 

22  Force  (FRCE) 


Please  Specify  Event  Types: 

1.  All  cooperative  events 

2.  All  conflictual  events 

3.  All  events 

4.  Combination  2 

Specify  dates:  (a.y.  6681-6684)  7685-7885 


date:  799311  ictor!  719  event!  IKI  Uriili  lit  inM!  • 
hina  charges  that  soviet  union  soldiers  uslnt  a 
i«ll0(«»Ur  an#  nllilary  boat*  croaa  the  border 
and  shoot  and  wound  sons  Chinese  chn  uar 

data:  799311  at  tor!  719  avantt  It)  tartet:  )»  at  ana  t 9 

china  tiHciali  report  that  soviet  union  soldiers 
croaa  tha  bordar  and  shoot  and  wound  sona  chmasa 
chn  uar 

data!  799311  actor!  719  avant!  137  taraat!  3*3  arena:  9 

the  china  areas  atency.  hslnhua*  aaya  that  chn  deputy 
fn  yu  chan  hands  a note  of  protest  to  anb  vastly 
tolstikov  in  paklna  on  tha  incident  of  usr  soldiers 
crossiny  tha  border  and  woundini 
sona  chmasa  usr  chn 

dote:  799311  actor!  7l9  event!  139  taraat:  3(3  arena:  9 

china  leader  hue  kuo-fane  reiterates  denands  that  the 
soviet  union  withdraw  its  troops  Iron  the  frontier  ration* 
aaree  to  Maintain  the  status  auo  on  the  border  and  avoid 
arned  clashes  chn  usr 

7ape  full. ..brass  MUHIN  to  continue 


date:  7995M  actor!  3*3  event!  113  taraat:  7)9  arena:  9 

china  officials  res<ort  that  soviet  union  soldiers  cross  me 
bordar  and  wound  socse  chn  soldiers  usr 

date:  799311  actor!  3(9  event!  147  taraat:  719  arena:  9 

the  soviet  union  conveys  rearets  to  chine  over  what  it 
says  was  an  accidental  crossing  by  a uar  patrol  into  chn 
territory  but  denies  peklna's  charpes  that  usr  nen  shot, 
beat  and  kicked  Chinese  dtiiens  uar  chn 

dote:  799313  actor!  719  event!  Ill  taraat:  3*3  arena:  9 

the  china  sovt  says  that  it  la  not  satisfied  with 
the  soviet  union's  e*p>anetion  of  why  usr  troori.  boats 
and  a helicopter  crossed  Into  Manchuria  earlier  this  ween 
chn  usr 

date:  799317  actor!  719  event!  199  tar«et:  3*3  arena:  9 

china  deputy  forties  Minister  yu  chan  reads  a note  to 
soviet  union  anb  totstlkov  that  says  tha  usr  c«ptanation 
of  a border  incident  that  wounded  several  chn  soldiers  is  n 
scceptsble  and  densnda  a fornal  reply  with  whs!  he  cells 
an  honest  sccnunt  chn  uar 

date  full... press  KliMN  te  continue 


<»U!  ’Mil*  actor:  fit  «*««(:  111  li'tti:  345  arena:  t 

china  tm  haany  hue  speaks  at  the  ana  cental  section  ana 
calls  the  soviet  anion  the  *nost  aonacroas  court  * at  a new 
war la  war*  cha  war 

acta:  ?M11»  attar:  fit  event:  in  target:  345  arena:  t 

china  tm  haenf  has  sneaks  at  the  ant.  coet  ial  section  on 
tioornenent  ana  attaces  the  soviet  anion  c>«  west  hint 
tisernenent  while  eepanama  ana  ear  lei  tine  their 
weaponry  chn  ear 


ante:  7tt529  actor:  345  event; 


ts'aet:  lit  arena: 


soviet  anion  aeteeote  oleo  troyanovaky  to  the  a*«  walks 
oat  of  china  tm  huena  hue  a cree.n  while  Ne  cays  ‘the  asr 
is  •ncreastne  its  nilitary  threat  v weiton  eurooai 
Strtvmy  to  Oceana  1 1 a |n«lMen>e  in  the  mdOle  east  ana 
cerrytat  oat  a series  ol  Military  aaveMc'ea  in  atrica*  ch 

Oo  yoa  want  to  look  at  wore  tact  (V  N>:n 


SSS  IMlY  MAONlMt  AMO  AOwHOAIMC  S>  SUP  ACTlUAlCt  SSS 


Are  wour  at  tors: 

I.  Coantnes 
I.  JCS  res ions 
3.  kth  I 

fleece  aelett  two  toantr lealyse.asr >:  atc-thn 

Spec  I ly  activity  How: 

t.  one  way  case  >>>  chn) 

i.  one  wow  <aaa  <<<  chn) 

. two  wee  lose  <->  cha)  2 

Select  tine  tmrenent: 

I.  Monthly 
I.  oaartarly 

3.  year  I a I 

Set  tine  e«reneters<75tl -7712):  77tl-7M5 


PROCESSING 

COMPLETED 


Nunbcr  of  events  found:  It 

Do  wou  desire  31  daw  probablistic  forecasts'* '•»>!  w 


< 


V. 


J 


! 


Monthly  Probability 
Jan.  1977  - Haw.  >’?» 


Sttt  use 

<<<>>>  chn  tst 

Date 

Probabi 1 i ty 

Jan  77 

.IS 

Feb  77 

.IS 

Mar  77 

.IS 

Apr  77 

.IS 

Maw  77 

.IS 

Jun  77 

.IS 

Jul  77 

.IS 

Au»  77 

.IS 

Sep  77 

.IS 

Oct  77 

.IS 

Nov  77 

.IS 

Dec  77 

.IS 

Jan  7S 

.IS 

Fab  7A 

.IS 

Mar  7t 

.IS 

Apr  7t 

.IS 

Haw  70 

.23 

URN  to  continue: 


< I 
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■ 


Monthly  Activity 
Jan,  1977  - Hoy,  1979 

«««  us«  <<<<<<  Two-Hoy  Flew  >>>>>>  thn  Stt 


Total 

Ac  tivl ty 

Cooperative  Activity 

Conflictual  Actjwj»y 

Date 

nunber 

s-acora 

pr  ob 

TiuNbcr 

i-score 

prob 

nunber 

x-scc>-e  orc-b 

Jon  77 

t 

-8.83 

8.19 

1 

-9.49 

9.19 

9 

-1.94 

9.  10 

Fab  77 

f 

-8.C5 

9.19 

2 

-8.28 

9.19 

9 

-1.93 

o.ie 

Mar  77 

C 

8.83 

9.13 

4 

9.12 

9.15 

2 

-9. 16 

9.  19 

Apr  77 

c 

8.83 

9.13 

3 

9.32 

9.13 

1 

-8.69 

6. 18 

Hay  77 

4 

-8.31 

9.19 

4 

9.12 

9.13 

9 

-1.82 

8. 10 

Jun  77 

4 

-8.31 

9.19 

4 

9.11 

9.15 

9 

-1.81 

8.18 

Jul  77 

• 

-1.89 

9.19 

9 

-9.69 

8.19 

9 

-1.99 

9.19 

Aus  77 

14 

1.43 

8.16 

14 

2.14 

9.21 

9 

-8.99 

0. 19 

Sep  77 

9 

9.SS 

9.13 

6 

9.38 

9.15 

3 

9.29 

0.  18 

Oct  77 

4 

-8.32 

9.19 

2 

-9.39 

9.19 

2 

-9.13 

9. 19 

Nov  77 

1 

-9.93 

9.19 

1 

-9.38 

8. 19 

9 

-8.99 

8. 10 

Dec  77 

2 

-8.63 

8.19 

1 

-9.39 

9.19 

1 

-8.53 

6. 10 

Jon  78 

9 

-1.89 

8.19 

9 

-8.79 

0. 19 

9 

-8.9S 

9. 19 

Feb  78 

3 

-8.47 

9.19 

2 

-9.29 

9.19 

1 

-8.34 

9. 16 

Har  78 

3 

-8.12 

9.19 

4 

9.12 

9.13 

1 

-8.54 

9. 18 

Apr  78 

2 

-8.64 

8. 19 

2 

-8.29 

9.  18 

0 

-0.97 

6. 18 

Hoy  78 

17 

2.89 

9.16 

12 

1.73 

8.21 

5 

1.21 

8.23 

RE TURK  to  continue: 


Monthly  Tension  and  Uncer taitity 
Jan,  1977  - Hoy,  1978 

tit  usa  <<<<<<  Two-Way  Flow  >>>>>>  chn  lit 


Date 

Tens  ion 

2-score 

H-rel 

2-score 

Jon  77 

9.9 

-1.19 

0.989 

-1.23 

Feb  77 

9.9 

-1.16 

8.990 

-1.21 

Har  77 

27.8 

-8.12 

9.430 

9.95 

Apr  77 

13.9 

-8.64 

9.327 

6.43 

Hay  77 

9.9 

-1.15 

9.900 

-1.22 

Jun  77 

9.9 

-1.14 

9.900 

-1.29 

Jul  77 

9.8 

-1.13 

9.900 

-1.19 

Auf  77 

9.9 

-1.11 

9.212 

-9.11 

Sep  77 

29.6 

9.99 

0.343 

9.54 

Oct  77 

37.3 

9.30 

9.336 

9.51 

Hov  77 

9.9 

-1.11 

9.900 

-1.28 

Dec  77 

23.9 

-8.16 

9.224 

-8.05 

Jan  79 

9.9 

-1.11 

9.000 

-1.19 

Feb  78 

22.2 

-8.26 

9.266 

-9.13 

Har  78 

16.9 

-8.49 

9.162 

-9.36 

Apr  79 

9.9 

-1.19 

9.900 

-1.19 

Hay  79 

27.7 

-9.93 

9.489 

1.31 

Do  you  wont  event  freeuenc icstym)?  n 


Event  Types 

Cooperative  Events: 
•1  Yield  <YLD> 

•2  Consent  (CRMT) 

63  Consult  <CMSL> 

64  Approve  (APPR) 

65  Promise  (PRHS) 

Conflictual  Events: 

11  Reject  (RJCT) 

12  Accuse  < ACUS > 

13  Protest  (PROT) 

14  Deny  (DENY) 

15  Demand  (DNND) 

16  Warn  (MARK) 


66  Grant  (GRMT > 

67  Reward  <REUD) 
6«  Aprec  (ACRE) 
69  Request  (ROST) 
16  Propose  (PROP) 


17  Threat  (THRT) 

16  Demonstrate  (DErtO) 
19  Reduce  (RDUC> 

26  Expel  (EXPL) 

21  Seize  (SEI?) 

22  Force  <FRCE> 


Please  Specify  Event  Types: 

1.  All  cooperative  events 

2.  All  conflictual  events 

3.  All  events 

4.  Combination  4 

Enter  event  types:  (e.y.  61,62.21..)  12,15,16 
Specify  dates:  (e.y.  6661-6664)  7665-7665 


date:  7665  S actor:  716  event:  is*  taryet:  2 arena:  6 

china  leader  hua  kuo-feny  calls  for  the  withdrawal  of 
usa  troops  from  south  korea  and  the  dissolution  of  the 
uno  command  chn  kos 

date:  7865  7 actor:  716  event:  121  tar  set:  2 arena:  6 

china  party  chairman  hua  kuo-feny  says  chn  would  never 
rccoynizc  south  korea  and  accuses  the  usa  of  pursuiny 
e policy  of  ayyression  in  korea  kos 

data:  760529  actor:  716  event:  121  taryet:  2 arena:  6 

china  fn  huany  hua  speaks  at  the  uno  special  session  on 
disarmament  and  accuses  the  usa  of  prcachiny  disarmament 
while  expandiny  and  per  fee  tiny  their  weaponry  chn 

data:  768529  actor:  716  event:  168  taryet:  2 arena:  8 

china  fm  huany  hua  speaks  at  the  uno  special  session  on 
disarmament  and  calls  the  soviet  union  the  *most  danyerous 
source  of  a new  world  war*  and  warns  washinyton  that  a 
policy  of  appeasiny  the  usr  will  only  briny  war  closer 
chn  usa 

Do  you  want  to  look  at  more  text  (Y'N>:n 
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tt<  early  warning  and  monitoring  system  activated  **• 


Af*  your  «c  tort: 

1.  Countries 

2.  JCS  rations 

3.  Both  3 


tit  REGIONAL  OPTIONS  **» 


JCS  REGIONS 


1.  North  America  <NAM> 

2.  Central  end  South  Anerica  <CSA> 

3.  Mestern  Europe — Hedi terannean  Atlontic  'WEN) 

4.  Eastern  Europe — Soviet  Union  (ESU) 

5.  Middle  East  and  North  Africa  (MEA) 

6.  East  Asia  and  Pacific  (EAP) 

7.  South  Asia  and  Sub-Saharan  Africa  (SAS) 

8.  World  (NOR) 

9.  Special  Purpose  Action  <SPR> 

Do  you  wont  a list  of  actors  in  a resJonCy-nJ'n 

Select  a country  and  a ret ion(uta»nea):  isr, spr 

Specify  activity  flow: 

8.  one  way  (isr  >>>  tor) 

1.  one  way  <iar  <<<  spr) 

2.  two  way  (isr  <->  spr)  2 

Select  tine  increment: 


J 


196 


f 


197 


Monthly  Tendon  end  Uncertainty 
Jon,  1977  - Hay,  1978 

m tor  <<<<<<  Two-Way  Flow  >>>>>>  tor  »«> 


Date 

Tension  2- 

-score 

M-rel  2 

-score 

Jan 

77 

34.7 

-8.22 

8.617 

1.38 

Fab 

77 

48.8 

-8.43 

8.431 

8.38 

Mar 

77 

€6.7 

8. 1C 

8. 28€ 

-8.73 

Aor 

77 

41.7 

-8.64 

8.327 

-8.13 

Hay 

77 

€6.7 

8.17 

8.355 

8.81 

Jun 

77 

25.8 

-1.17 

8.224 

-8.64 

Jul 

77 

43.8 

-8.56 

0.561 

1.84 

Am 

77 

38.8 

-8.72 

8.527 

8.86 

Sap 

77 

36.8 

-8. 15 

8.586 

8.75 

Oct 

77 

48.8 

-8.41 

8.387 

-8.25 

Now 

77 

14.1 

-1.52 

8.4ef 

8.65 

Dec 

77 

18.1 

-1.36 

8.475 

8.39 

Jan 

78 

36.5 

-8.75 

8.395 

1.19 

Feb 

78 

48.8 

-8.  €3 

8.481 

8.28 

Har 

78 

24.1 

-1.14 

8.445 

8.42 

Apr 

78 

39.8 

-8.62 

s.see 

8.74 

Hay 

78 

44.3 

-8.47 

8.426 

8.32 

Do  you  want  event  frcauenc let <y'n>7  n 
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List  of  Publications 
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APPENDIX  B 

EARLY  WARNING  AND  MONITORING  PROJECT 
LIST  OF  PUBLICATIONS 


RESEARCH  MEMORANDUMS 

1.  Subject:  Monitoring  for  Crisis  Early  Warning 

Author:  Richard  W.  Parker 

Date:  October  29,  1976 

2.  Subject:  Usefulness  of  Diplomatic  Exchange  Data  Base 

and  Software 

Author:  Richard  W.  Parker 

Date:  November  4,  1976 

3.  Subject:  Joystick  Application 

Author:  James  F.  Wittmeyer 

Date:  November  15,  1976 

4.  Subject:  Bayes,  Blalock  and  Best  Estimates:  Hindsighting 

the  Czech  Invasion 
Author:  Stephen  J.  Andriole 

Date:  November  12,  1976 

5.  Subject:  Support  and  Test  Programs 

Author:  James  F.  Wittmeyer 

Date:  January  15,  1977 

6.  Subject:  Integration  and  Use  of  Additional  Inter- 

national Indicators 
Author:  Stephen  J.  Andriole 

Date:  January  10,  1977 

7.  Subject:  Generation  and  Use  of  More  Salient 

Probability  Conversion  Tables 
Author:  Stephen  J.  Andriole 

Date:  January  14,  1977 

8.  Subject:  Using  Economic  Indicators  for  Crisis  Monitoring 

and  Forecasting 
Author:  Richard  W.  Parker 

Date:  March  28,  1977 

9.  Subject:  "Correcting"  Crisis  Indicators 

Author:  Richard  W.  Parker 

Date:  March  28,  1977 
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10.  Subject:  All  vs.  All:  Warning  and  Monitoring  in 

the  Aggregate  Level 
Author:  Judith  Ayres  Daly 

Date:  March  7,  1977 

11.  Subject:  Record  of  Miscellaneous  Runs 

Author:  Judith  Ayres  Daly 

Date:  April  4,  1977 

12.  Subject:  ROZ : Preliminary  Tests  and  Analyses 
Authors:  Judith  Ayres  Daly  and  James  F.  Wittmeyer,  III 
Date:  July  29,  1977 

13.  Unassigned 

14.  Subject:  Probability  Tables 

Authors:  Judith  Ayres  Daly  and  Brenda  D.  Bell 
Date:  August  5,  1977 

15.  Subject:  A Preliminary  Comparison  of  Political  and 

Military  Indicators  (Classified) 

Author:  Judith  Ayres  Daly 
Date:  September  21,  1977 

16.  Subject:  Weighting  Tension  for  Improved  Warning  and 

Monitoring  Performance 

Authors:  Judith  Ayres  Daly  and  Brenda  D.  Bell 
Date:  September  30,  1977 

17.  Unassigned 

18.  Subject:  Regional  Tension:  A Middle  East  Case  Study 

Author:  Judith  Ayres  Daly 

Date:  November  1,  1977 

19.  Subject:  Weighting  Tension:  An  Examination  of  Cell 

Frequencies 

Author:  Thomas  R.  Davies 
Date:  December  16,  1977 

20.  Subject:  Pre-Crisis  Peaks,  False  Alarms,  and  Conflict 

Event  Types 

Author:  Thomas  R.  Davies 
Date:  February  15,  1978 

21.  Subject:  Early  Warning  and  Monitoring  System  Software 
Author:  Brenda  D.  Bell 

Date:  February  22,  1978 

22.  Subject:  Problems  of  Applied  Monitoring  and  Warning 

Author:  Judith  Ayres  Daly 

Date:  March  15,  1978 


201 


Wmm"  — 

I 

23.  Subject:  Bits  about  DDF 

Author:  Brenda  D.  Bell 

Date:  Forthcoming 

24.  Subject:  Testing  the  Warning  Capabilities  of  a 

New  Tension  Indicator 
Author:  Thomas  R.  Davies 
Date:  Forthcoming 


JOINT  RESEARCH  MEMORANDUMS 

1.  Subject:  Increasing  the  Sample  for  the  Cross-National 
Crisis  Indicators  Project 

Authors:  Judith  Ayr<»s  Daly,  Decisions  and  Designs, 

Incorporated,  and  Gerald  W.  Hopple,  University  of 
Maryland 

Date:  October  28,  1977 

TECHNICAL  REPORTS 

TR  76-19 

Subject:  Progress  Report  on  the  Development  of  an 

Integrated  Crisis  Warning  System 
Author:  Stephen  J.  Andriole 

Date:  December  1976 

TR  76-20 

Subject : Software  Design  for  an  Interactive  Crisis  Early 

Warning  Prototype  System 
Author:  James  F.  Wittmeyer 

Date:  December  1976 

TR  76-21 

Subject : Crisis  and  Crisis  Forecasting:  An  Analytical 

Review  of  the  Literature 
Author:  Richard  W.  Parker 
Date:  December  1976 


Subject : Users  Manual  for  the  Early  Warning  and  Moni- 

toring System 
Author:  Thomas  R.  Davies 

Date:  Forthcoming 


ANNUAL  PROGRESS  REPORTS 

1.  Subject:  Crisis  Early  Warning  and  Monitoring  System 
Period:  1 October  1976-30  September  1977 

Date:  November  29,  1977 

t 
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OTHER  PUBLICATIONS 


Articles 


1.  Title:  Conceptualizing  an  Integrated  Crisis  Warning 

System 

Authors:  Stephen  J.  Andriole  and  Robert  A.  Young 

Journal:  Journal  of  Defense  Research 

Date:  Spring  1977 

2.  Title:  The  Development  of  a Prototype  Crisis  Early 

Warning  System 

Authors:  Stephen  J.  Andriole  and  Robert  A.  Young 

Journal:  Journal  of  Defense  Research 

Date:  Spring  197? 

3.  Title:  Toward  the  Development  of  an  Integrated  Crisis 

Warning  System 

Authors:  Stephen  J.  Andriole  and  Robert  A.  Young 

Journal:  International  Studies  Quarterly 

Date:  March  1977 

4.  Title:  Examination  of  Basic  and  Applied  International 

Crisis  Research 
Author:  Richard  W.  Parker 

Journal:  International  Studies  Quarterly 

Date:  March  1977 

5.  Title:  Computers  and  Crisis:  Monitoring  and  Forecasting 

International  Political  Affairs 
Author:  Stephen  J.  Andriole,  Brenda  D.  Bell,  Judith 

Ayres  Daly,  Thomas  R.  Davies,  James  F.  Wittmeyer, 
and  Robert  A.  Young 

Journal:  The  World  Future  Society  Bulletin 
Date:  May/June  1978 


Conference  Papers 

1.  Title:  Decision  Process  Models  and  the  Needs  of 

Policy-Makers:  Thoughts  on  the  Foreign  Policy 
Interface 

Author:  Stephen  J.  Andriole 

Conference:  International  Studies  Association 

Place:  Toronto,  Canada 
Date:  February  1976 

1 

2.  Title:  Bayes,  Blalock,  and  Best  Estimates 

Author:  Stephen  J.  Andriole 

Conference:  Southern  Political  Science  Association 

Place:  Atlanta,  Georgia 

Date:  November  1976 
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3. 


Title:  Crisis  Early  Warning  in  a Regional  Subsystem: 

The  Middle  East  Case 

Authors:  Judith  Ayres  Daly  and  Richard  W.  Parker 

Conference:  Society  for  General  Systems  Research 

Place:  Denver,  Colorado 

Date:  February  1977 

4.  Title:  Monitoring  and  Forecasting  International  Crises: 

The  Use  of  Economic  Indicators 
Author:  Richard  W.  Parker 

Conference:  International  Studies  Association 

Place:  St.  Louis,  Missouri 

Date:  March  1977 

5.  Title:  A Crisis  Early  Warning  Prototype  System 
Author:  Judith  Ayres  Daly 

Conference:  39th  MORS  (Military  Operations  Research) 

Place:  Annapolis,  Maryland 
Date:  June  1977 

6.  Title:  Application  of  an  Early  Warning  and  Monitoring 

System:  The  Middle  East 
Author:  Judith  Ayres  Daly 

Conference:  International  Studies  Association 

Place:  Washington,  DC  „ 

Date:  February  1978 
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c: 


List  of  Those  Who  Have  Viewed  the  Early 
Warning  and  Monitoring  System  Demonstration 
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APPENDIX  C 


LIST  OF  THOSE  WHO  HAVE  VIEWED  THE  EARLY  WARNING 
AND  MONITORING  SYSTEM  DEMONSTRATION 

Government  Agencies 

T.  Belden,  Intelligence  Community  Staff 

B.  Blechman,  Department  of  State 

W.  R.  Broach,  Defense  Intelligence  Agency 

G.  Bryan,  Office  of  Naval  Research 

S.  Buckley,  National  War  College 

L.  Capone,  Defense  Communication  Agency 

D.  A.  Charvonia,  Defense  Advanced  Research  Projects  Agency,  Europe 
S.  L.  D'Orazio,  Defense  Intelligence  Agency 
J.  P.  Duffy,  Defense  Intelligence  Agency 
R.  Elliott,  Department  of  State 

L.  D.  Faurer,  European  Command  (EUCOM) 

J.  Floyd,  Defense  Intelligence  Agency 

R.  R.  Fossum,  Defense  Advanced  Research  Projects  Agency 
R.  M.  Ghormley,  Defense  Communication  Agency 

M.  Hayes,  Defense  Advanced  Research  Projects  Agency 
L.  Hazlewood,  Central  Intelligence  Agency 

W.  D.  Henderson,  Office  of  the  Secretary  of  Defense 

D.  Howell,  Department  of  State 

J.  L.  Houlgate,  Defense  Intelligence  Agency 
B.  B.  Johnson,  Defense  Intelligence  Agency 

E.  L.  Johnson,  Office  of  Naval  Research 

F.  Kapper,  Office  of  the  Secretary  of  Defense 
J.  E.  Kelly,  Defense  Intelligence  Agency 

G.  W.  Krieser,  Defense  Intelligence  Agency 
J.  Levan,  United  States  Air  Force,  Europe 

H.  Lobdell,  National  War  College 

D.  Looft,  Defense  Advanced  Research  Projects  Agency 

D.  Mahley,  National  War  College 

D.  K.  Malone,  Defense  Intelligence  Agency 
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B.  Marecic,  Naval  Postgraduate  School 

J.  Markowitz,  Central  Intelligence  Agency 

A.  Marshall,  Office  of  the  Secretary  of  Defense 
J.  A.  Nagay,  Office  of  Naval  Research 

C.  H.  Norton,  Defense  Intelligence  Agency 
J.  R.  Pettit,  Defense  Intelligence  Agency 
J.  Robbins,  Central  Intelligence  Agency 
G.  E.  Ruhl,  Defense  Intelligence  Agency 

B.  J.  Schick,  Defense  Intelligence  Agency 
R.  G.  Sherwin,  Naval  Postgraduate  School 
A.  Smith,  Central  Intelligence  Agency 

J.  E.  Snyder,  Defense  Intelligence  Agency 

V.  Spoto,  Office  of  Commander-in-Chief,  Atlantic  Fleet, 

Norfolk  (CINCLANT) 

J.  Stark,  Office  of  the  Chief  of  Naval  Operations 
R.  Winterberg,  Central  Intelligence  Agency 

Research  and  Development  Institutions 
J.  Ballentine,  Systems  Planning  Corporation 
M.  Ben  Bassat,  Perceptronics , Incorporated 

W.  Beyers,  Mitre  Corporation 

A.  Clarkson,  Electromagnetic  Systems  Laboratories 

M.  A.  Daniels,  International  Public  Policy  Research  Corporation 

D.  Druckman,  Mathtech,  Incorporated 
J.  Fain,  CACI,  Incorporated 

J.  M.  Fox,  Decisions  and  Designs,  Incorporated 
R.  Gerenz,  Betac,  Incorporated 
D.  Guertin,  Exxon  Corporation 

R.  Hayes,  CACI,  Incorporated 

G.  Heilmeier,  Texas  Instruments 

G.  W.  Hopple,  International  Public  Policy  Research  Corporation 
W.  Howard,  Systems  Planning  Corporation 

S.  Kaplan,  The  Brookings  Institution 

C.  W.  Kelly,  Decisions  and  Designs,  Incorporated 

B.  Kelly,  BDM  Corporation 
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A.  W.  Kibler,  Decisions  and  Designs,  Incorporated 
J.  Kudzie,  RCA  Corporation 
T.  Marril,  Computer  Corporation  of  America 
J.  Paisley,  Mitre  Corporation 

C.  R.  Peterson,  Decisions  and  Designs,  Incorporated 

D.  Poe,  BDM  Corporation 

J.  B.  Rothnie,  Computer  Corporation  of  America 

L.  Russo,  Exxon  Corporation 

W.  Shawcross,  Decisions  and  Designs,  Incorporated 

C.  Sherbrook,  Mathtech,  Incorporated 

R.  0.  Slater,  Mathtech,  Incorporated 

A.  Snyder,  Computer  Corporation  of  America 

M.  D.  Van  Orden,  Decisions  and  Designs,  Incorporated 

A.  R.  Wagner,  Analytical  Assessments  Corporation 
G.  Weltman,  Perceptronics , Incorporated 

Colleges  and  Universities 

R.  Butterworth,  Pennsylvania  State  University 

S.  Chan,  University  of  Maryland 
W.  Domke,  University  of  Michigan 

G.  T.  Duncan,  Carnegie-Mellon  University 
J.  Gillespie,  Indiana  University 

B.  L.  Job,  University  of  Minnesota-Twin  Cities 

J.  Kidd,  University  of  Maryland 

J.  Kringen,  University  of  Maryland 
J.  Kugler,  Boston  University 

C.  A.  McClelland,  University  of  Southern  California 

D.  McCormick,  University  of  Maryland 

W.  R.  Martin,  California  State  College/Dominguez  Hills 

J.  F.  K.  Organski,  University  of  Michigan 

W.  Phillips,  University  of  Maryland 

P.  Rossa,  University  of  Maryland 

F.  Rothe,  University  of  Southern  California 

P.  Werbos,  University  of  Maryland 

J.  Wilkenfeld,  University  of  Maryland 

D.  Zinnes,  Indiana  University 
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j>^\This  technical  report  documents  and  summarizes  the  progress  made 
_ toward  the  development  of  a crisis  early  warning  and  monitoring  system. 
Chapter  1 reviews  the  crisis  warning  problem  and  proposed  solution. 
Chapter  2 summarizes  the  contract  tasking  and  project  accomplishments. 
The  components  of  the  early  warning  system  and  their  interrelationships 
are  detailed  in  Chapter  3.  Chapter  4 reports  on  progress  in  developing 
new  indicators  and  software  capabilities.  Chapter  5 documents  develop- 
ments made  in  transferring  and  demonstrating  the  prototype  system.  The 
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^current  status  of  the  blend  between  empirical  and  decision  analytic 
warning  methodologies  is  described  in  Chapter  6.  Chapter  7 outlines 
future  research  developments  to  be  designed,  tested,  and  integrated. 

The  Early  Warning  and  Monitoring  system  is  comprised  of  several 
main  components  including  quantitative  indicators,  general  scans,  a 
forecasting  methodology,  and  an  interactive  computer  base.  The  quan- 
titative indicators  Include  international  political  indicators  of 
activity,  tension,  and  uncertainty.  The  monthly  forecasts  are  based  on 
extensive  retrospective  tests  of  past  crisis  behavior.  Testing  has 
shown  that  the  computer-based  system  is  capable  of  substantially  improving 
the  defense  community's  ability  to  forecast  specific  international 
crises, 

A combination  of  interaction  with  potential  users  and  research 
findings  has  resulted  in  substantial  modifications  to  the  original 
design  of  the  warning  and  monitoring  system.  The  quantitative  political 
indicators  have  been  modified,  and  extensive  testing  has  resulted  in 
higher  hit  rates  and  lower  false  alarm  rates.  Progress  has  been  made 
on  developing  new  indicators  such  as  regional  and  systemic  ones. 

Daily  updated  data  has  permitted  testing  on  all  components  of  the 
warning  system  in  a real-time  mode.  Also,  preliminary  testing  has  begun 
focusing  on  comparing  political  and  military  indicators  in  historical 
crises.  Finally,  research  on  the  overlap  between  empirical  science  and 
decision-analytic  methodologies  has  resulted  in  the  identification  of 
several  potential  methods  of  integration. 
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